-- Logs begin at Thu 2022-10-20 12:57:22 UTC, end at Thu 2022-10-20 13:53:45 UTC. -- Oct 20 13:27:00.325982 dv-cinder-862136-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 20 13:27:00.334616 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 20 13:27:00.336579 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 20 13:27:00 2022] *** Oct 20 13:27:00.336579 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 20 13:27:00.336579 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 20 13:27:00.336579 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: nodename: dv-cinder-862136-1-iscsi Oct 20 13:27:00.336579 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: machine: x86_64 Oct 20 13:27:00.336579 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: clock source: unix Oct 20 13:27:00.336579 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: pcre jit disabled Oct 20 13:27:00.336579 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: detected number of CPU cores: 4 Oct 20 13:27:00.336579 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: current working directory: / Oct 20 13:27:00.336579 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: detected binary path: /usr/bin/uwsgi-core Oct 20 13:27:00.337373 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: your processes number limit is 47680 Oct 20 13:27:00.337373 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: your memory page size is 4096 bytes Oct 20 13:27:00.337373 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: detected max file descriptor number: 2048 Oct 20 13:27:00.337373 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: lock engine: pthread robust mutexes Oct 20 13:27:00.337373 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: thunder lock: enabled Oct 20 13:27:00.337373 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 20 13:27:00.337373 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 20 13:27:00.376121 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: Python main interpreter initialized at 0x5628685849c0 Oct 20 13:27:00.376121 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: python threads support enabled Oct 20 13:27:00.376121 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: your server socket listen backlog is limited to 100 connections Oct 20 13:27:00.376121 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: your mercy for graceful operations on workers is 90 seconds Oct 20 13:27:00.376451 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: mapped 403077 bytes (393 KB) for 2 cores Oct 20 13:27:00.376540 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: *** Operational MODE: preforking *** Oct 20 13:27:00.376779 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: *** uWSGI is running in multiple interpreter mode *** Oct 20 13:27:00.376779 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: spawned uWSGI master process (pid: 103949) Oct 20 13:27:00.376985 dv-cinder-862136-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 20 13:27:00.379781 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: spawned uWSGI worker 1 (pid: 103950, cores: 1) Oct 20 13:27:00.379781 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: spawned uWSGI worker 2 (pid: 103951, cores: 1) Oct 20 13:27:00.379781 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 20 13:27:01.034719 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 13:27:01.037504 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 13:27:02.114460 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:27:02.114460 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: from cryptography.utils import int_from_bytes Oct 20 13:27:02.115052 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:27:02.115052 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: from cryptography.utils import int_from_bytes Oct 20 13:27:02.116143 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:27:02.116143 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: from cryptography.utils import int_from_bytes Oct 20 13:27:02.116582 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:27:02.116582 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: from cryptography.utils import int_from_bytes Oct 20 13:27:04.599826 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 13:27:04.600352 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 13:27:04.600592 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 13:27:04.600974 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 13:27:04.601231 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 13:27:04.601613 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.601769 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 13:27:04.602118 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.602214 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 13:27:04.602293 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.602533 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.602628 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 13:27:04.603108 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.603193 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 13:27:04.603282 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.603369 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 13:27:04.603545 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.603633 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.603860 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.603954 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.604183 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.604268 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.604440 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.604533 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.604750 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.604855 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.605096 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862136-1-iscsi {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.605251 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.605421 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.605506 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.605723 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.605810 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.606030 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.606114 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.606344 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.606428 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.606643 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.606729 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.606956 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.607040 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862136-1-iscsi {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.607256 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.607352 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.607586 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.607747 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.607907 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.608922 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.609061 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.609190 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.609308 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.609437 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.609573 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.609701 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.609814 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.609942 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.610062 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.610203 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.610324 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.610444 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.610579 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.610716 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.610846 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.610967 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.611085 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.611204 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.611334 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.611460 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862136-1-iscsi {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.611581 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.611700 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.611829 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.611949 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.612075 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.612195 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.612344 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.612556 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.612717 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.612857 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.613060 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862136-1-iscsi {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.613198 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.613380 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.613520 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.613694 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.613831 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.614005 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.614129 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.614347 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.614472 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.614660 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.614803 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.614975 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.615110 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.615293 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.615436 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.615590 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.615726 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.615891 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.616027 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.616193 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.616337 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.616504 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.616626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.616803 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.616982 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.617112 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.617240 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.617370 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.617492 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.617646 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.617771 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.617961 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.618085 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.618851 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.619339 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.619466 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.619600 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.619732 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.619870 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.619995 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.620119 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.620248 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.620379 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.620509 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.620641 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.620766 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.620910 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.621038 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.621159 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.621299 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.621424 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.621424 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.621670 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.621794 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.621916 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.622046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.622168 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.622332 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.622479 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.622702 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.622921 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.623055 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.623217 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.623347 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.623470 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.623591 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.623721 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.623847 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.623968 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.624090 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.624218 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.624403 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.624546 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.624712 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.624838 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.625048 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.625174 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.625369 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.625505 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.625680 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.625806 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.625986 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.626110 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.626297 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.626435 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.626610 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.626745 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.626912 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.627046 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.627211 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.627338 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.627510 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.627636 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.627821 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.627946 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.628145 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.628273 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.628443 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.628581 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.628705 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.628968 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.629108 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.629232 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.629365 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.629515 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.629640 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.629767 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.629898 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.630021 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.630144 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.630272 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.630431 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.630574 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.630725 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.630862 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.631025 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.631163 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.631323 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.631723 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.631893 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.632019 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.632185 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.632316 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.632476 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.632621 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.632823 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.632972 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.633096 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.633219 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.633368 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.633512 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.633666 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.633792 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.634933 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.635067 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.635227 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.635366 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.635504 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.635628 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.635750 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.635871 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.636001 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.636126 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.636256 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.636379 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.636502 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.636624 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.636745 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.636899 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.637037 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.637169 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.637292 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.637413 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.637544 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.637668 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.637790 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.637920 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.638044 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.638166 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.638351 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.638480 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.638649 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.638775 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.638989 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.639131 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.639269 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.639394 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.639516 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.639651 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.639812 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.639938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.640121 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.640249 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.640418 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.640546 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.640716 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.640842 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.641021 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.641177 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.641311 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.641480 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.641605 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.641785 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.641925 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.642104 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.642230 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.642409 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.642542 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.642714 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.642851 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.643042 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.643168 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.643295 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.643417 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.643600 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.643734 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.643895 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.644031 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.644194 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.644329 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.644496 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.644616 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.644797 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.644941 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.645140 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.645265 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.645462 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.645589 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.645768 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.645896 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.646074 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.646209 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.646380 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.646504 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.646700 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.646824 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:27:04.647009 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.647146 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.647316 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.647440 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.647635 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.647758 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.647939 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.648077 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.648246 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.648372 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.648552 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.648676 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.648906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.649051 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.649239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.649365 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.649542 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.650081 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.650289 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.650424 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.650574 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.650707 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.650838 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.650970 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.651104 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.651228 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.651351 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.651477 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.651601 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.651723 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.651853 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.651978 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.652100 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.652259 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.652387 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.652587 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.652726 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.652912 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.653055 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.653251 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.653378 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.653537 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.653683 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.653845 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.653971 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.654151 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.654287 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.654459 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.654586 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.654795 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.654924 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.655103 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.655230 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.655410 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.655538 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.655730 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.655868 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.656038 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.656171 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.656355 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.656483 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.656661 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.656785 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.656993 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.657123 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.657301 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.657437 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.657606 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.657732 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.657911 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.658050 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.658241 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.658367 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.658550 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.658689 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.658866 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.659002 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.659176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.659379 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.659508 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.659628 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.659782 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.659918 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.660088 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.660222 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.660393 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.660522 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.660697 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.660833 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.661030 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.661157 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.661323 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.661450 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.661624 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.661763 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.661926 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.662054 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.662226 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.662356 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.662533 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.662673 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.662852 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.662978 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.663154 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.663365 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.663506 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.663630 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.663753 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.663876 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.664063 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.664192 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.664369 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.664496 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.664676 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.664803 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.665008 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.665210 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.665660 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.665825 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.665958 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.666083 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.666204 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.666373 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.666498 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.666620 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.666741 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.666882 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.667061 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.667238 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.667374 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.667546 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.667671 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.667850 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.667975 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.668164 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.668289 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.668472 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.668596 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.668780 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.668938 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.669112 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.669237 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.669430 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.669576 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.669728 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.669860 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.670034 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.670167 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.670340 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.670466 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.670646 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.670778 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.670965 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.671096 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.671271 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.671402 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.671583 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.671715 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.671897 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.672021 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.672206 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.672337 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.672508 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.672710 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.672835 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.672985 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.673109 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.673241 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.673457 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.673591 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.673713 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.673833 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.673998 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.674123 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.674298 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.674426 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.674596 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.674722 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.674893 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.675025 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.675191 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.675319 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.675488 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.675614 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.675810 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.675936 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.676114 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.676240 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.676412 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.676541 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.676710 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.676844 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.677031 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.677156 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.677368 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.677494 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.677666 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.677813 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.677970 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.678094 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.678276 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.678401 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.678602 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.678739 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.678915 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.679046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.679220 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.679343 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.679524 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.679654 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.679829 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.679930 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.680132 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.680233 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.680439 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.680538 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.681403 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.681506 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.681817 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.681903 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.682143 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.682232 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.682472 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.682558 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.682779 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.682865 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.683100 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.683267 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.683405 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.683556 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.683774 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.683916 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.684061 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.684198 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.684332 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.684467 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.684608 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.684751 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.685066 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.685221 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.685221 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.685485 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.685620 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.685767 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.685903 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.686035 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.686175 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.686309 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.686443 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.686585 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.686720 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.686856 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.686999 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.687140 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.687281 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.687430 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.687599 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.687741 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.687903 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.688118 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.688260 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.688404 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.688540 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.688674 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.688808 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.688975 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.689124 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.689255 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.689455 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.689575 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.689831 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.689972 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.690110 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.690244 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.690384 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.690524 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.690657 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.690790 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.690943 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.691084 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.691217 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.691386 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.691520 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.691710 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.691859 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.692022 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.692150 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.692339 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.692473 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.692646 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.692788 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.692971 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.693057 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.693295 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.693378 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.693608 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.693695 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.693917 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.694021 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.694224 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.694308 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.694526 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.694612 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.694835 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.694926 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.695141 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.695226 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.695440 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.695525 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.695739 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.695822 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.696046 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.696128 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.697092 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.697226 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.697305 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.697382 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.697582 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.697680 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.697899 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.697983 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.698201 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.698286 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.698500 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.698592 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.698817 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.698902 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.699122 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.699205 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.699422 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.699518 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.699791 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.699894 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.700021 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.700107 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.700344 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.700437 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.700656 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.700738 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.700980 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.701068 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.701296 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.701383 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.701601 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.701691 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.701910 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.701995 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.702222 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.702309 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.702527 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.702610 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.702832 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.702914 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.703136 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.703220 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.703451 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.703578 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.703758 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.703897 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.704099 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.704226 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.704352 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.704472 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.704652 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.704784 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.704981 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.705107 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.705300 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.705438 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.705606 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.705741 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.705911 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.706043 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.706217 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.706348 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.706521 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.706660 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.706827 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.706952 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.707140 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.707263 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.707454 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.707704 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.707831 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.708033 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.708157 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.708345 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.708478 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.708662 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.708789 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.708999 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.709124 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.709313 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.709448 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.709619 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.709764 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.709968 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.710094 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.710237 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.710370 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.710538 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.710810 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.710936 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.711134 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.711266 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.711436 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.711569 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.711743 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.711870 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.712155 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.712282 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.712469 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.712604 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.712772 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.712917 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.713105 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.713231 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.713407 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.713544 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.713707 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.713843 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.714006 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.714208 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.714343 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.714472 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.714607 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.714736 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.714893 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.715026 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.715199 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.715333 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.715501 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.715630 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.715819 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.715952 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.716123 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.716257 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.716427 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.716552 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.716728 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.716853 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.717052 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.717193 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.717386 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.717523 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.717686 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.717810 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.717999 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.718131 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.718314 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.718438 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.718622 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.718747 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.718940 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.719064 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.719241 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.719367 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.719544 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.719667 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.719847 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.719996 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.720183 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.720310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.720431 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.720552 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.720724 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.720851 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.721054 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.721178 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.721353 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.721478 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.721659 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.721785 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.721962 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.722086 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.722268 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.722402 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.722575 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.722707 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.722874 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.722999 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.723181 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.723320 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.723481 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.723607 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.723789 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.723920 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.724092 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.724244 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.724431 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.724558 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.724679 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.724800 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.724991 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.725131 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.725296 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.725422 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.725593 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.725717 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.725913 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.726045 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.726167 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.726288 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.726487 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.726615 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.726788 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.726921 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.727088 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.727213 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.727385 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.727511 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.727714 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.727841 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.728019 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.728143 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.728318 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.728442 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.728639 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.728766 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.728958 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.729090 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.729259 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.729392 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.729559 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.729685 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.729863 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.729996 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.730235 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.730379 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.730503 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.730624 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.730751 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.730880 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.731063 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.731198 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.731374 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.731505 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.731674 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.731800 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.731978 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.732144 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.732270 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.732390 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.732566 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.732692 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.732882 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.733012 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.733192 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.733319 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.733490 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.733615 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.733788 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.733916 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.734084 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.734209 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.734381 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.734583 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.734719 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.734849 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.734981 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.735102 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.735267 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.735397 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.735565 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.735691 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.735864 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.735989 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.736163 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.736297 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.736500 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.736626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.736799 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.736942 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.737126 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.737263 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.737434 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.737559 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.737742 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.737868 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.738066 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.738200 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.738370 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.738493 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.738674 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.738798 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.738983 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.739116 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.739281 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.739414 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.739590 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.739722 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.739895 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.740021 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.740200 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.740399 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.740532 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.740655 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.740786 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.740949 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.741109 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.741233 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.741414 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.741541 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.741718 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.741844 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.742032 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.742164 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.742348 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.742480 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.742664 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.742790 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.742961 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.743086 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.743789 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.743929 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.744098 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.744225 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.744402 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.744527 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.744727 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.744880 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.745006 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.745127 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.745317 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.745444 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.745624 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.745757 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.745929 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.746054 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.746234 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.746358 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.746537 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.746670 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.746842 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.746967 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.747146 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.747271 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.747448 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.747587 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.747748 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.747879 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.748066 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.748190 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.748367 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.748500 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.748665 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.748801 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.749052 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.749171 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.749371 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.749481 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.749684 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.749783 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.749982 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.750077 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.750298 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.750395 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.750612 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.750709 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.750921 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.751026 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.751248 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.751345 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.751557 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.751651 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.751860 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.751963 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.752166 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.752261 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.752471 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.752565 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.752767 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.752890 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.753102 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.753205 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.753492 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.753576 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.753797 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.753901 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.754103 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.754202 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.754400 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.754485 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.754696 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.754862 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.755003 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.755107 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.755318 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.755403 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.755615 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.755703 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.755915 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.756017 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.756211 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.756328 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.756802 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.756922 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.757127 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.757238 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.757443 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.757551 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.757852 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.757940 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.758154 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.758239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.758450 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.758542 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.759376 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.759629 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.759770 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.759991 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.760079 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.760306 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.760400 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.760629 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.760713 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.760959 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.761049 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.761282 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.761369 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.761585 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.761699 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.761896 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.762015 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.762203 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.762324 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.762523 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.762741 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.762834 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.763056 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.763142 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.763369 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.763464 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.763697 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.763782 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.764022 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.764125 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.764345 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.764453 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.764643 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.764741 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.764981 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.765069 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.765296 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.765385 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.765624 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.765710 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.765949 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.766035 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.766263 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.766353 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.766580 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.766665 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.766882 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.767029 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.767182 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.767270 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.767492 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.767579 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.767792 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.767887 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.768094 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.768180 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.768411 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.768531 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.768711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.768858 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.769042 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.769191 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.769346 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.769521 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.769650 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.769846 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.769954 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.770156 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.770242 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.770464 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.770552 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.770778 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.770866 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.771085 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.771185 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.771395 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.771490 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.771720 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.771806 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.772027 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.772112 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.772340 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.772439 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.772652 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.772738 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.772980 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.773070 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.773285 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.773383 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.773586 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.773679 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.773883 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.774033 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.774200 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.774295 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.774532 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.774617 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.774848 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.775037 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.775174 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.775369 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.775496 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.775696 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.775802 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.776005 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.776129 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.776332 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.776447 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.776647 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.776762 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.776985 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.777086 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.777298 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.777385 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.777604 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.777689 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.777953 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.778048 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.778261 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.778346 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.778563 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.778656 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.778863 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.778949 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.779162 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.779255 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.779462 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.779558 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.779764 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.779850 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.780061 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.780147 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.780358 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.780468 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.780655 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.780782 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.780992 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.781130 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.781291 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.781458 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.781607 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.781764 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.781911 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.782070 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.782207 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.782383 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.782504 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.782689 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.782802 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.782994 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.783137 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.783300 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.783434 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.783610 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.783755 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.783915 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.784061 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.784220 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.784379 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.784525 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.784690 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.784848 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.785024 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.785175 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.785335 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.785499 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.785643 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.785811 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.785953 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.786117 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.786261 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.786423 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.786568 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.786727 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.786874 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.787070 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.787184 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.787376 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.787496 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.787706 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.787800 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.788019 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.788311 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.788399 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.788634 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.788726 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.788970 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.789061 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.789282 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.789367 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.789592 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.789688 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.789902 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.789988 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.790732 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.790822 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.791042 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.791137 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.791351 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.791446 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.791661 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.791754 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.791969 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.792063 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.792289 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.792381 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.792604 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.792816 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.792947 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.793173 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.793261 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.793494 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.793591 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.793814 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.793910 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.794133 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.794219 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.794453 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.794540 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.794772 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.794866 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.795090 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.795176 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.795390 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.795475 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.795700 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.795790 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.796011 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.796097 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.796319 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.796404 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.796624 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.796711 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.796951 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.797041 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.797266 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.797351 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.797574 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.797671 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.797880 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.797966 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.798187 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.798282 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.798495 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.798581 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.798803 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.798888 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.799119 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.799213 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.799448 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.799534 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.799761 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.799847 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.800070 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.800158 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.800377 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.800462 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.800686 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.800771 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.801019 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.801224 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.801338 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.801534 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.801653 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.801860 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.801958 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.802178 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.802265 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.802495 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.802580 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.802807 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.802901 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.803119 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.803208 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.803440 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.803527 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.803743 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.803831 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.804045 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.804130 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.804351 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.804440 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.804656 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.804786 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.804983 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.805244 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.805330 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.805566 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.805675 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.805953 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.806045 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.806312 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.806398 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.806647 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.806735 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.806970 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.807176 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.807291 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.807513 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.807608 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.807826 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.807914 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.808145 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.808233 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.808464 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.808559 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.808777 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.808894 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.809106 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.809193 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.809424 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.809521 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.809726 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.809812 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.810028 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.810115 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.810339 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.810427 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.810643 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.810832 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.810943 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.811177 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.811278 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.811524 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.811618 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.811828 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.811912 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.812127 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.812226 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.812432 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.812525 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.812728 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.812814 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.813099 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.813200 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.813425 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.813509 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.813726 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.813818 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.814025 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.814113 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.814329 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.814422 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.814629 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.814716 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.814928 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.815013 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.815225 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.815311 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.815523 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.815608 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.815830 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.815917 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.816129 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.816222 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.816434 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.816526 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.816734 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.816822 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.817067 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.817154 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.817377 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.817474 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.817686 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.817772 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.817994 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.818079 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.818306 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.818400 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.818604 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.818689 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.818904 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.818990 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.819208 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.819303 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.819512 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.819596 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.819824 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.819910 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.820130 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.820223 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.820434 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.820520 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.820738 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.820899 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.821075 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.821251 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.821938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.822259 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.822413 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.822569 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.822766 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.822895 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.823096 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.823203 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.823434 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.823519 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.823766 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.823853 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.824075 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.824161 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.824391 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.824478 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.824699 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.824786 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.825046 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.825145 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.825358 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.825520 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.825674 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.825769 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.825983 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.826229 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.826316 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.826567 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.826655 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.826885 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.826969 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.827194 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.827281 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.827502 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.827596 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.827814 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.827900 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.828121 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.828215 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.828427 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.828512 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.828732 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.828816 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.829066 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.829170 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.829374 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.829462 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.829685 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.829777 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.829998 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.830094 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.830312 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.830399 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.830621 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.830713 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.830930 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.831024 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.831241 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.831333 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.831547 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.831632 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.831851 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.831939 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.832158 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.832245 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.832464 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.832563 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.832774 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.832902 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.833113 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.833201 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.833420 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.833504 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.833722 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.833810 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.834066 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.834373 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.834473 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.834685 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.834772 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.835001 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.835130 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.835315 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.835403 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.835623 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.835711 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.835932 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.836016 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.836245 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.836330 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.836552 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.836647 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.836884 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.837506 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.837757 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.837855 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.838094 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.838185 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.838432 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.838760 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.838844 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.839082 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.839170 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.839385 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.839480 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.839690 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.839776 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.839994 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.840081 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.840300 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.840386 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.840614 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.840708 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.840948 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.841087 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.841251 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.841337 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.841552 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.841646 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.841858 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.841944 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.842158 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.842271 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.842460 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.842603 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.842759 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.842933 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.843060 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.843245 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.843363 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.843554 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.843662 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.843864 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.843949 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.844180 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.844274 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.844498 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.844584 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.844810 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.844918 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.845131 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.845266 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.845436 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.845521 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.845731 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.845816 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.846031 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.846126 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.846330 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.846415 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.846630 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.846715 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.846928 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.847022 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.847238 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.847322 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.847543 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.847628 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.847850 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.847937 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.848155 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.848241 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.848461 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.848546 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.848768 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.848880 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.849098 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.849186 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.849414 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.849501 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.849716 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.849802 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.850022 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.850108 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.850327 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.850425 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.850631 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.850716 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.850936 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.851026 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.851244 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.851338 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.851551 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.851643 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.851858 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.851960 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.852165 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.852259 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.852471 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.852583 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.852912 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.853047 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.853241 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.853342 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.853544 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.853631 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.853865 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.853958 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.854176 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.854264 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.854489 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.854574 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.854801 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.854886 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.855109 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.855206 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.855428 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.855516 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.855733 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.855819 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.856040 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.856127 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.856346 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.856432 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.856652 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.856748 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.856982 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.857082 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.857297 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.857383 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.857609 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.857705 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.857917 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.858003 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.858229 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.858314 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.858541 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.858635 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.858858 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.858943 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.859176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.859262 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.859482 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.859568 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.859802 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.859889 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.860113 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.860200 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.860427 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.860514 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.860741 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.860827 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.861089 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.861189 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.861408 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.861496 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.861717 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.861806 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.862024 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.862110 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.862323 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.862410 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.862562 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 13:27:04.862649 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.862962 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.863289 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.863603 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.863931 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.864260 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.864607 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.864950 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.865300 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.865630 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.865947 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.866261 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.866568 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:27:04.866815 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 13:27:05.016555 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO dbcounter [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Registered counter for database nova_api Oct 20 13:27:05.020072 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Registered counter for database nova_api Oct 20 13:27:05.037271 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG oslo_db.sqlalchemy.engines [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:27:05.039877 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:27:05.044792 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writer thread running {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:27:05.047131 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:27:05.101363 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.context [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f1966287-b3a3-4c20-97b3-61dda7e72f23(cell1) {{(pid=103951) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 13:27:05.104108 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.context [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f1966287-b3a3-4c20-97b3-61dda7e72f23(cell1) {{(pid=103950) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 13:27:05.105970 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG oslo_concurrency.lockutils [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:27:05.106440 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG oslo_concurrency.lockutils [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:27:05.107961 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:27:05.108061 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG oslo_concurrency.lockutils [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:27:05.108702 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG oslo_concurrency.lockutils [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:27:05.109148 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:27:05.109261 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG oslo_concurrency.lockutils [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:27:05.110728 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:27:05.111248 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG oslo_concurrency.lockutils [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:27:05.111463 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:27:05.111909 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:27:05.113594 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO dbcounter [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Registered counter for database nova_cell0 Oct 20 13:27:05.113912 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:27:05.116010 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Registered counter for database nova_cell0 Oct 20 13:27:05.117699 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO dbcounter [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Registered counter for database nova_cell1 Oct 20 13:27:05.120710 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Registered counter for database nova_cell1 Oct 20 13:27:05.125666 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG oslo_db.sqlalchemy.engines [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:27:05.127534 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG oslo_db.sqlalchemy.engines [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:27:05.129020 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:27:05.132490 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:27:05.133652 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writer thread running {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:27:05.136063 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:27:05.139163 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writer thread running {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:27:05.275577 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:27:05.280870 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO dbcounter [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Registered counter for database nova_cell0 Oct 20 13:27:05.285337 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Registered counter for database nova_cell0 Oct 20 13:27:05.289632 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG oslo_db.sqlalchemy.engines [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:27:05.294337 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:27:05.294654 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writer thread running {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:27:05.299066 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:27:05.630263 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 13:27:05.631267 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: WARNING keystonemiddleware.auth_token [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 13:27:05.638252 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 13:27:05.639579 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: WARNING keystonemiddleware.auth_token [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 13:27:05.980373 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: WARNING keystonemiddleware.auth_token [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 13:27:05.981068 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 13:27:05.986244 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: WARNING keystonemiddleware.auth_token [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 13:27:05.986912 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 13:27:05.991469 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628685849c0 pid: 103951 (default app) Oct 20 13:27:05.992133 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628685849c0 pid: 103950 (default app) Oct 20 13:27:05.994094 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:27:05.995262 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-e762f4da-1058-4126-97e1-7fe05557e300 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002273 Oct 20 13:27:05.995673 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Thu Oct 20 13:27:05 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:27.034029 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:27.035372 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002181 Oct 20 13:28:27.035779 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:28:27.046840 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writing DB stats nova_api:SELECT=3 {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:27.047986 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writing DB stats nova_cell1:SELECT=3 {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:27.048836 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writing DB stats nova_cell0:SELECT=3 {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:27.051590 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:27.919805 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-aea10a37-efee-4220-a2ca-298ed101518f admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:27.953624 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-aea10a37-efee-4220-a2ca-298ed101518f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.911877 Oct 20 13:28:27.954534 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 20 13:28:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:28:30.607993 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:30.609108 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-50ca8ef0-445f-4c4d-b8aa-938c389ab793 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 20 13:28:30.609648 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:31.073249 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-dcb7e3d6-1ed0-4f94-86f2-e3c46b63a5c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:31.121960 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-dcb7e3d6-1ed0-4f94-86f2-e3c46b63a5c3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505849 Oct 20 13:28:31.122552 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 20 13:28:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:28:31.138729 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=3 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:31.140790 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell0:SELECT=3 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:31.141586 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell1:SELECT=3 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:31.142684 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:31.347942 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-6e339ccf-c2d9-4a9d-a908-5efd4c9b6731 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:31.417772 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-6e339ccf-c2d9-4a9d-a908-5efd4c9b6731 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284443 Oct 20 13:28:31.418358 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 20 13:28:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:28:34.017797 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-dcb7e3d6-1ed0-4f94-86f2-e3c46b63a5c3 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:34.019409 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-dcb7e3d6-1ed0-4f94-86f2-e3c46b63a5c3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Oct 20 13:28:34.019807 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:34.680728 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-6098b0e7-d177-44ba-8193-121909cc971c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:34.723796 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-6098b0e7-d177-44ba-8193-121909cc971c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.697787 Oct 20 13:28:34.725007 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 20 13:28:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:28:34.738841 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-4ad4b699-2b09-467c-889e-ab8624b14531 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:34.790329 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-4ad4b699-2b09-467c-889e-ab8624b14531 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056455 Oct 20 13:28:34.791200 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 20 13:28:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:28:37.441128 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-6098b0e7-d177-44ba-8193-121909cc971c admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:37.442269 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-6098b0e7-d177-44ba-8193-121909cc971c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002347 Oct 20 13:28:37.442767 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:37.858823 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-ca7de9c4-333b-4e12-9408-516fa0909264 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "swap": 0, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:37.879587 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-ca7de9c4-333b-4e12-9408-516fa0909264 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429978 Oct 20 13:28:37.880132 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 20 13:28:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:28:37.892402 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-fb82b5a0-0e55-4a85-bb90-fd398dc843c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:37.923242 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-fb82b5a0-0e55-4a85-bb90-fd398dc843c6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034598 Oct 20 13:28:37.924042 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 20 13:28:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:28:40.530656 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-ca7de9c4-333b-4e12-9408-516fa0909264 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:40.531657 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-ca7de9c4-333b-4e12-9408-516fa0909264 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 20 13:28:40.532251 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:40.947781 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a3c872a4-3475-40b8-92ef-e42a7f1d1fd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:40.967796 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a3c872a4-3475-40b8-92ef-e42a7f1d1fd9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429377 Oct 20 13:28:40.968907 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 20 13:28:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:28:40.981358 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-4615a575-bfcb-4cfb-a0ce-7824eeea3237 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:41.011676 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-4615a575-bfcb-4cfb-a0ce-7824eeea3237 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033884 Oct 20 13:28:41.012313 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 20 13:28:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:28:43.650252 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a3c872a4-3475-40b8-92ef-e42a7f1d1fd9 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:43.651283 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a3c872a4-3475-40b8-92ef-e42a7f1d1fd9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 20 13:28:43.651691 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:44.057248 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-0c573728-80dc-4737-9122-8a689c3e2d74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:44.078910 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-0c573728-80dc-4737-9122-8a689c3e2d74 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.420904 Oct 20 13:28:44.080889 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 20 13:28:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 13:28:44.093790 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-f857b4f6-7094-492b-bed3-1f75e37c42c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:44.122538 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-f857b4f6-7094-492b-bed3-1f75e37c42c0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032374 Oct 20 13:28:44.123143 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 20 13:28:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:28:46.866377 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-0c573728-80dc-4737-9122-8a689c3e2d74 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:46.867515 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-0c573728-80dc-4737-9122-8a689c3e2d74 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001821 Oct 20 13:28:46.867917 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:47.277257 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-3db6c8c7-37ff-49de-a054-5373ebe1566f admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:47.302377 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-3db6c8c7-37ff-49de-a054-5373ebe1566f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.426988 Oct 20 13:28:47.302931 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 20 13:28:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:28:49.959661 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-0c573728-80dc-4737-9122-8a689c3e2d74 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:49.960958 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-0c573728-80dc-4737-9122-8a689c3e2d74 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002961 Oct 20 13:28:49.961566 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:50.384606 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-cf1fc874-5b8e-4c71-b407-cb5e924b6ff9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "vcpus": 1}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:50.408739 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-cf1fc874-5b8e-4c71-b407-cb5e924b6ff9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.439502 Oct 20 13:28:50.409481 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 20 13:28:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 13:28:50.425188 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-89d74104-2486-4d77-8a50-499f41cbf0c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:50.458299 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-89d74104-2486-4d77-8a50-499f41cbf0c8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038015 Oct 20 13:28:50.458876 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 20 13:28:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:28:53.072701 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-cf1fc874-5b8e-4c71-b407-cb5e924b6ff9 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:53.073746 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-cf1fc874-5b8e-4c71-b407-cb5e924b6ff9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 20 13:28:53.074147 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:53.468900 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-0ed13ccb-c042-4729-9998-12ffc67f2f99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "swap": 0, "id": "2", "ram": 2048}} {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:53.487530 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-0ed13ccb-c042-4729-9998-12ffc67f2f99 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407000 Oct 20 13:28:53.488208 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 20 13:28:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 13:28:53.500179 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-d68f0c54-7eab-43b0-a024-e9d4ee0add54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:53.524797 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-d68f0c54-7eab-43b0-a024-e9d4ee0add54 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028192 Oct 20 13:28:53.525769 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 20 13:28:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:28:56.119451 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-0ed13ccb-c042-4729-9998-12ffc67f2f99 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:56.120367 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-0ed13ccb-c042-4729-9998-12ffc67f2f99 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 20 13:28:56.121097 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:56.494887 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a232afd0-33a1-4ff4-b46e-1ff1de069e3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:56.523667 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a232afd0-33a1-4ff4-b46e-1ff1de069e3d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.395784 Oct 20 13:28:56.524465 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 20 13:28:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 13:28:56.537205 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-f439c8ce-a7d0-465c-b867-508761a765d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:56.566913 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-f439c8ce-a7d0-465c-b867-508761a765d6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033560 Oct 20 13:28:56.568256 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 20 13:28:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:28:59.186766 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a232afd0-33a1-4ff4-b46e-1ff1de069e3d admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:28:59.187765 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a232afd0-33a1-4ff4-b46e-1ff1de069e3d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 20 13:28:59.188640 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:28:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:28:59.695935 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-b3bf255a-e62b-4ea2-8289-6aa16bcafed7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "disk": 80, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:59.707561 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:59.721022 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-b3bf255a-e62b-4ea2-8289-6aa16bcafed7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.526451 Oct 20 13:28:59.721759 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 20 13:28:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:28:59.733546 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-cf7b019d-51ec-4095-b9d6-9dadfa7c0319 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:28:59.757368 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-cf7b019d-51ec-4095-b9d6-9dadfa7c0319 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027298 Oct 20 13:28:59.765887 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 20 13:28:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:29:02.411304 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-b3bf255a-e62b-4ea2-8289-6aa16bcafed7 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:02.412303 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-b3bf255a-e62b-4ea2-8289-6aa16bcafed7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 20 13:29:02.412702 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:29:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:29:02.871103 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-2d59f8eb-4cfa-4120-b489-9e8e48e10af4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "id": "5", "vcpus": 8}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:29:02.882077 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:02.895596 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-2d59f8eb-4cfa-4120-b489-9e8e48e10af4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.476749 Oct 20 13:29:02.896456 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 20 13:29:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:29:02.910510 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-1ae435d9-fcd1-469f-b8ee-8b8b09bf53e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:29:02.936905 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-1ae435d9-fcd1-469f-b8ee-8b8b09bf53e1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032053 Oct 20 13:29:02.945277 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 20 13:29:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:29:22.214984 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-2d59f8eb-4cfa-4120-b489-9e8e48e10af4 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:22.216035 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-2d59f8eb-4cfa-4120-b489-9e8e48e10af4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 20 13:29:22.216441 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:29:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:29:22.226984 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:22.600231 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-7221254f-dac8-4d1b-b766-0f5a0a94a168 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:22.619066 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-7221254f-dac8-4d1b-b766-0f5a0a94a168 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396466 Oct 20 13:29:22.619591 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 20 13:29:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:29:23.927239 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-2d59f8eb-4cfa-4120-b489-9e8e48e10af4 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:23.928287 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-2d59f8eb-4cfa-4120-b489-9e8e48e10af4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 20 13:29:23.928681 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:29:24.441695 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-ef7d937f-728e-4986-a1e5-aa6c9e681e02 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:24.447026 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.wsgi [None req-ef7d937f-728e-4986-a1e5-aa6c9e681e02 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-ef7d937f-728e-4986-a1e5-aa6c9e681e02 admin admin] Request method failure captured: Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Accept: application/json Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Accept-Encoding: gzip, deflate Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Connection: keep-alive Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Content-Length: 0 Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Host: 10.222.0.23 Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Openstack-Api-Version: compute 2.92 Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Openstack-System-Scope: None Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: User-Agent: python-novaclient Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Auth-Token: gAAAAABjUU0z5zqXHS483TX2vptWrhCfPND9pjjWCMZfXLRHpbOXEXl4KkmPKMHkwq9YH297RSZEWJXn0hYDU2iSmDX-m4jxQtJkj-_LhEns9Q__RF3M3eR1wadCDDw8ld2CK4cGWL7lieHp3I2mMAcvwVkN-cuWh4tEHMwJ6GuDW2jaqQ42GqQ Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Domain-Id: None Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Domain-Name: None Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Identity-Status: Confirmed Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Is-Admin-Project: True Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Domain-Id: default Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Domain-Name: Default Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Name: admin Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Role: admin,member,reader Oct 20 13:29:24.450239 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Roles: admin,member,reader Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Tenant: admin Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Tenant-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Tenant-Name: admin Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User: admin Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Domain-Id: default Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Domain-Name: Default Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Id: b0595b7096954e6a802224bb45e3f3cf Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Name: admin Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: method: > Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: exception: Flavor 42 could not be found. Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: action_args: {'id': '42'} Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:29:24.451869 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:24.453116 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:24.454517 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-ef7d937f-728e-4986-a1e5-aa6c9e681e02 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:29:24.455759 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-ef7d937f-728e-4986-a1e5-aa6c9e681e02 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387041 Oct 20 13:29:24.455759 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 20 13:29:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:24.462356 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-515bd11e-6e42-4ac3-9532-77ddff1bb164 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:24.485722 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-515bd11e-6e42-4ac3-9532-77ddff1bb164 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027658 Oct 20 13:29:24.486251 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 20 13:29:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:29:24.496649 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-5155e3d8-d304-45fc-b726-2f43056b58f7 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:24.520315 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-5155e3d8-d304-45fc-b726-2f43056b58f7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028078 Oct 20 13:29:24.520898 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 20 13:29:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:29:24.530463 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-2de2f8ad-53ad-4f83-88bd-8b961ca7fc54 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:24.535814 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.wsgi [None req-2de2f8ad-53ad-4f83-88bd-8b961ca7fc54 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-2de2f8ad-53ad-4f83-88bd-8b961ca7fc54 admin admin] Request method failure captured: Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Accept: application/json Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Accept-Encoding: gzip, deflate Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Connection: keep-alive Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Content-Length: 0 Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Host: 10.222.0.23 Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Openstack-Api-Version: compute 2.92 Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Openstack-System-Scope: None Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: User-Agent: python-novaclient Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Auth-Token: gAAAAABjUU0z5zqXHS483TX2vptWrhCfPND9pjjWCMZfXLRHpbOXEXl4KkmPKMHkwq9YH297RSZEWJXn0hYDU2iSmDX-m4jxQtJkj-_LhEns9Q__RF3M3eR1wadCDDw8ld2CK4cGWL7lieHp3I2mMAcvwVkN-cuWh4tEHMwJ6GuDW2jaqQ42GqQ Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Domain-Id: None Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Domain-Name: None Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Identity-Status: Confirmed Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Is-Admin-Project: True Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Id: default Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Name: Default Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Name: admin Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Role: admin,member,reader Oct 20 13:29:24.539018 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Roles: admin,member,reader Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Tenant: admin Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Tenant-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Tenant-Name: admin Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User: admin Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Id: default Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Name: Default Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Id: b0595b7096954e6a802224bb45e3f3cf Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Name: admin Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: method: > Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: exception: Flavor 42 could not be found. Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: action_args: {'id': '42'} Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:29:24.540626 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:24.541725 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:24.543096 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-2de2f8ad-53ad-4f83-88bd-8b961ca7fc54 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:29:24.544305 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-2de2f8ad-53ad-4f83-88bd-8b961ca7fc54 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013542 Oct 20 13:29:24.544305 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 20 13:29:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:25.770518 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-5155e3d8-d304-45fc-b726-2f43056b58f7 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:25.771522 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-5155e3d8-d304-45fc-b726-2f43056b58f7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 20 13:29:25.771916 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:29:26.297474 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-abe8e273-6400-42f2-9a70-2d84bb1b9256 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:26.302446 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.wsgi [None req-abe8e273-6400-42f2-9a70-2d84bb1b9256 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-abe8e273-6400-42f2-9a70-2d84bb1b9256 admin admin] Request method failure captured: Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Accept: application/json Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Accept-Encoding: gzip, deflate Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Connection: keep-alive Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Content-Length: 0 Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Host: 10.222.0.23 Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Openstack-Api-Version: compute 2.92 Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Openstack-System-Scope: None Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: User-Agent: python-novaclient Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Auth-Token: gAAAAABjUU01yOsC0SgxpVtHwdkmr-VOO0O3Blt43py4IgxWGhsf756aIVFE7DuBP_r-LGPACQgmmK_mGWbLKmhQZMQw2dl-xXZUJGa5ssoUiBXiaHJ8pEcnDGu2O2e3GHQ8cV4qLeUQ5jwVdL5MOWj_j4gzeA81y4rYRE4xHET7aHcxXUZeUWU Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Domain-Id: None Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Domain-Name: None Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Identity-Status: Confirmed Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Is-Admin-Project: True Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Id: default Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Name: Default Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Name: admin Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Role: admin,member,reader Oct 20 13:29:26.303938 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Roles: admin,member,reader Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Tenant: admin Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Tenant-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Tenant-Name: admin Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User: admin Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Id: default Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Name: Default Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Id: b0595b7096954e6a802224bb45e3f3cf Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Name: admin Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: method: > Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: exception: Flavor 84 could not be found. Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: action_args: {'id': '84'} Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:29:26.305449 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:26.306310 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:26.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-abe8e273-6400-42f2-9a70-2d84bb1b9256 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:29:26.308382 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-abe8e273-6400-42f2-9a70-2d84bb1b9256 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.395310 Oct 20 13:29:26.308382 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 20 13:29:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:26.315318 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-d6674e0e-ef46-45e2-91d3-c8f849d5f6e7 admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:26.330018 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-d6674e0e-ef46-45e2-91d3-c8f849d5f6e7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018435 Oct 20 13:29:26.330533 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 20 13:29:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:29:26.339789 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-028204f7-32bb-4cec-97b8-9f522282d0db admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:26.355255 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-028204f7-32bb-4cec-97b8-9f522282d0db admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018960 Oct 20 13:29:26.355791 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 20 13:29:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:29:26.365555 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-12932d56-9bc9-4a89-81bc-38935a3b547e admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:26.370415 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.wsgi [None req-12932d56-9bc9-4a89-81bc-38935a3b547e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-12932d56-9bc9-4a89-81bc-38935a3b547e admin admin] Request method failure captured: Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Accept: application/json Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Accept-Encoding: gzip, deflate Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Connection: keep-alive Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Content-Length: 0 Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Host: 10.222.0.23 Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Openstack-Api-Version: compute 2.92 Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Openstack-System-Scope: None Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: User-Agent: python-novaclient Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Auth-Token: gAAAAABjUU01yOsC0SgxpVtHwdkmr-VOO0O3Blt43py4IgxWGhsf756aIVFE7DuBP_r-LGPACQgmmK_mGWbLKmhQZMQw2dl-xXZUJGa5ssoUiBXiaHJ8pEcnDGu2O2e3GHQ8cV4qLeUQ5jwVdL5MOWj_j4gzeA81y4rYRE4xHET7aHcxXUZeUWU Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Domain-Id: None Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Domain-Name: None Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Identity-Status: Confirmed Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Is-Admin-Project: True Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Domain-Id: default Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Domain-Name: Default Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Name: admin Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Role: admin,member,reader Oct 20 13:29:26.371906 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Roles: admin,member,reader Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Tenant: admin Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Tenant-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Tenant-Name: admin Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User: admin Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Domain-Id: default Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Domain-Name: Default Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Id: b0595b7096954e6a802224bb45e3f3cf Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Name: admin Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: method: > Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: exception: Flavor 84 could not be found. Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: action_args: {'id': '84'} Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:29:26.373711 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:26.374677 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:26.376202 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-12932d56-9bc9-4a89-81bc-38935a3b547e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:29:26.377433 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-12932d56-9bc9-4a89-81bc-38935a3b547e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011204 Oct 20 13:29:26.377433 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 20 13:29:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:27.590650 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-028204f7-32bb-4cec-97b8-9f522282d0db admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:27.591683 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-028204f7-32bb-4cec-97b8-9f522282d0db admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 20 13:29:27.592821 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:29:28.128934 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-77e2d398-1857-4494-af74-9157ecac6caa admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:28.134724 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.wsgi [None req-77e2d398-1857-4494-af74-9157ecac6caa admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-77e2d398-1857-4494-af74-9157ecac6caa admin admin] Request method failure captured: Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Accept: application/json Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Accept-Encoding: gzip, deflate Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Connection: keep-alive Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Content-Length: 0 Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Host: 10.222.0.23 Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Openstack-Api-Version: compute 2.92 Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Openstack-System-Scope: None Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: User-Agent: python-novaclient Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Auth-Token: gAAAAABjUU03Ce6L8tTjHpd-loqjjOBQuJ-5MJGp46TmcyK70_Vcv0om--9AYW-jYxuj6HvdqarXVcIV7PQ9UyPmoF9t-GBrWAd8BPVxPxQJ6IEyu_thJYaRzz3uTpol3o1yodi-W3cPdv3OCYNtpcIddpwqcLO2w1MtObAE5E1uFoz-Re9VVp0 Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Domain-Id: None Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Domain-Name: None Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Identity-Status: Confirmed Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Is-Admin-Project: True Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Domain-Id: default Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Domain-Name: Default Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Project-Name: admin Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Role: admin,member,reader Oct 20 13:29:28.136216 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Roles: admin,member,reader Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Tenant: admin Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Tenant-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-Tenant-Name: admin Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User: admin Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Domain-Id: default Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Domain-Name: Default Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Id: b0595b7096954e6a802224bb45e3f3cf Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: X-User-Name: admin Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: method: > Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: exception: Flavor 451 could not be found. Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: action_args: {'id': '451'} Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:29:28.137746 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:28.138602 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: ERROR nova.api.openstack.wsgi Oct 20 13:29:28.140046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-77e2d398-1857-4494-af74-9157ecac6caa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:29:28.141141 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-77e2d398-1857-4494-af74-9157ecac6caa admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.406389 Oct 20 13:29:28.141141 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 20 13:29:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:28.147471 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-e74a5e7e-c4c6-4e11-a48b-e45cf809df9f admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:28.162072 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-e74a5e7e-c4c6-4e11-a48b-e45cf809df9f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018190 Oct 20 13:29:28.162613 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 20 13:29:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:29:28.172365 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:28.187524 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019133 Oct 20 13:29:28.188046 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 20 13:29:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:29:28.197242 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-62139740-9f55-4611-b5e4-610e974cc627 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:28.202680 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.wsgi [None req-62139740-9f55-4611-b5e4-610e974cc627 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-62139740-9f55-4611-b5e4-610e974cc627 admin admin] Request method failure captured: Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Accept: application/json Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Accept-Encoding: gzip, deflate Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Connection: keep-alive Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Content-Length: 0 Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Host: 10.222.0.23 Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Openstack-Api-Version: compute 2.92 Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Openstack-System-Scope: None Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: User-Agent: python-novaclient Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Auth-Token: gAAAAABjUU03Ce6L8tTjHpd-loqjjOBQuJ-5MJGp46TmcyK70_Vcv0om--9AYW-jYxuj6HvdqarXVcIV7PQ9UyPmoF9t-GBrWAd8BPVxPxQJ6IEyu_thJYaRzz3uTpol3o1yodi-W3cPdv3OCYNtpcIddpwqcLO2w1MtObAE5E1uFoz-Re9VVp0 Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Domain-Id: None Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Domain-Name: None Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Identity-Status: Confirmed Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Is-Admin-Project: True Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Id: default Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Name: Default Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Project-Name: admin Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Role: admin,member,reader Oct 20 13:29:28.204176 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Roles: admin,member,reader Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7d49958a3a448d0bed98efad34bc0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Tenant: admin Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Tenant-Id: c7d49958a3a448d0bed98efad34bc0a2 Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-Tenant-Name: admin Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User: admin Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Id: default Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Name: Default Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Id: b0595b7096954e6a802224bb45e3f3cf Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: X-User-Name: admin Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: method: > Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: exception: Flavor 451 could not be found. Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: action_args: {'id': '451'} Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:29:28.205719 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:28.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Oct 20 13:29:28.207562 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-62139740-9f55-4611-b5e4-610e974cc627 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:29:28.208609 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-62139740-9f55-4611-b5e4-610e974cc627 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012021 Oct 20 13:29:28.208609 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 20 13:29:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:29.418800 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:29.419807 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 20 13:29:29.420287 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:29:29.947474 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-2393f28f-81d3-4331-b7b7-f5c31b690568 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:29:29.967624 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-2393f28f-81d3-4331-b7b7-f5c31b690568 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.408620 Oct 20 13:29:29.968169 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 20 13:29:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:29:31.166747 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:31.167750 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 20 13:29:31.168146 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:29:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:29:31.697598 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a487a62c-7da0-4cd1-afda-2347408f3081 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:29:31.716213 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a487a62c-7da0-4cd1-afda-2347408f3081 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.410492 Oct 20 13:29:31.717303 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 20 13:29:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:29:32.934951 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:32.936628 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Oct 20 13:29:32.937073 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:29:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:29:33.463127 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-bc5fb751-a6d7-43cb-8347-682a802ba597 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:29:33.482083 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-bc5fb751-a6d7-43cb-8347-682a802ba597 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.406480 Oct 20 13:29:33.482614 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 20 13:29:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:29:34.692574 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:34.693616 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 20 13:29:34.694012 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:29:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:29:35.214918 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-5d93a095-8050-4d3b-b952-ad7eaba2a9c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:29:35.233998 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-5d93a095-8050-4d3b-b952-ad7eaba2a9c3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402709 Oct 20 13:29:35.234558 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 20 13:29:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:29:36.460564 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:36.461635 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 20 13:29:36.462032 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:29:36.984085 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-894bbbb5-2872-4560-b278-439ba2c6d293 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:29:37.004847 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-894bbbb5-2872-4560-b278-439ba2c6d293 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402026 Oct 20 13:29:37.005411 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Thu Oct 20 13:29:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:30:33.728277 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:30:33.729359 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-a2c81d0c-31a2-4362-b2d6-492e32e3833f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Oct 20 13:30:33.729765 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 20 13:30:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:30:33.740711 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:34.143292 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-7967ba40-41ab-495e-80ac-e713a09ec67d admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:30:34.164298 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-7967ba40-41ab-495e-80ac-e713a09ec67d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.427994 Oct 20 13:30:34.164836 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 20 13:30:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:30:34.187862 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writing DB stats nova_api:SELECT=14 {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:34.191872 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-2ceb6b89-f768-42ab-a40f-deb990d5039e admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:30:34.199520 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-2ceb6b89-f768-42ab-a40f-deb990d5039e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013736 Oct 20 13:30:34.200377 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1283 bytes} [Thu Oct 20 13:30:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:30:34.212052 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-89e66c2b-1773-419a-806f-4aad995ea6d2 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:30:34.221494 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-89e66c2b-1773-419a-806f-4aad995ea6d2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013049 Oct 20 13:30:34.222079 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1286 bytes} [Thu Oct 20 13:30:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:30:34.234359 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-bf9a5d19-0fed-4cd0-87d1-318e9e1a389b admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:30:34.242254 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-bf9a5d19-0fed-4cd0-87d1-318e9e1a389b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011970 Oct 20 13:30:34.242831 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1286 bytes} [Thu Oct 20 13:30:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:30:34.255050 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a23362e8-febf-4885-9052-6088a6ac2f7b admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:30:34.262761 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a23362e8-febf-4885-9052-6088a6ac2f7b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011375 Oct 20 13:30:34.263325 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1283 bytes} [Thu Oct 20 13:30:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:33:30.905392 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-bf9a5d19-0fed-4cd0-87d1-318e9e1a389b admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:33:30.906396 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-bf9a5d19-0fed-4cd0-87d1-318e9e1a389b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 20 13:33:30.906785 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:33:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:33:31.047863 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=6 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:33:31.205438 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-38199fff-a60f-47de-b176-3d1e6a2d6b60 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:33:31.210155 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-38199fff-a60f-47de-b176-3d1e6a2d6b60 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:33:31.210627 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-38199fff-a60f-47de-b176-3d1e6a2d6b60 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:33:31.211053 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-38199fff-a60f-47de-b176-3d1e6a2d6b60 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:33:31.211762 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-38199fff-a60f-47de-b176-3d1e6a2d6b60 admin admin] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:33:31.212203 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-38199fff-a60f-47de-b176-3d1e6a2d6b60 admin admin] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:33:31.212620 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-38199fff-a60f-47de-b176-3d1e6a2d6b60 admin admin] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:33:31.244084 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-38199fff-a60f-47de-b176-3d1e6a2d6b60 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197525 Oct 20 13:33:31.244636 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 20 13:33:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:33:32.337291 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-bf9a5d19-0fed-4cd0-87d1-318e9e1a389b admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:33:32.338296 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-bf9a5d19-0fed-4cd0-87d1-318e9e1a389b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 20 13:33:32.338720 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:33:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:33:32.532570 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-6efbe87c-99db-4dfb-a062-6e9adf68f495 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:33:32.536781 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-6efbe87c-99db-4dfb-a062-6e9adf68f495 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:33:32.537277 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-6efbe87c-99db-4dfb-a062-6e9adf68f495 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:33:32.537724 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-6efbe87c-99db-4dfb-a062-6e9adf68f495 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:33:32.538419 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-6efbe87c-99db-4dfb-a062-6e9adf68f495 admin admin] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:33:32.538856 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-6efbe87c-99db-4dfb-a062-6e9adf68f495 admin admin] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:33:32.539263 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-6efbe87c-99db-4dfb-a062-6e9adf68f495 admin admin] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:33:32.558043 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-6efbe87c-99db-4dfb-a062-6e9adf68f495 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078634 Oct 20 13:33:32.558587 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 20 13:33:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:33:44.051262 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-bf9a5d19-0fed-4cd0-87d1-318e9e1a389b admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:33:44.052255 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-bf9a5d19-0fed-4cd0-87d1-318e9e1a389b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 20 13:33:44.052653 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:33:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:33:44.196575 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell0:SELECT=4 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:33:44.197370 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell1:SELECT=4 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:33:44.198043 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=8 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:33:44.246254 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-12c8f2af-1690-4291-95d4-229543f898f5 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:33:44.249772 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-12c8f2af-1690-4291-95d4-229543f898f5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:33:44.250247 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-12c8f2af-1690-4291-95d4-229543f898f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:33:44.250676 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-12c8f2af-1690-4291-95d4-229543f898f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:33:44.251389 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-12c8f2af-1690-4291-95d4-229543f898f5 admin admin] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:33:44.251832 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-12c8f2af-1690-4291-95d4-229543f898f5 admin admin] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:33:44.252245 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-12c8f2af-1690-4291-95d4-229543f898f5 admin admin] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:33:44.277490 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-12c8f2af-1690-4291-95d4-229543f898f5 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085202 Oct 20 13:33:44.277973 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 37/74] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 20 13:33:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:33:45.347165 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG nova.api.openstack.wsgi [None req-bf9a5d19-0fed-4cd0-87d1-318e9e1a389b admin admin] Calling method '>' {{(pid=103951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:33:45.348166 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: INFO nova.api.openstack.requestlog [None req-bf9a5d19-0fed-4cd0-87d1-318e9e1a389b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 20 13:33:45.348562 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: [pid: 103951|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 20 13:33:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:33:45.539398 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a1eb02fc-f8a9-410a-a8f5-690a333d2bd2 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:33:45.542803 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-a1eb02fc-f8a9-410a-a8f5-690a333d2bd2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:33:45.543269 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-a1eb02fc-f8a9-410a-a8f5-690a333d2bd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:33:45.543686 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-a1eb02fc-f8a9-410a-a8f5-690a333d2bd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:33:45.544386 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-a1eb02fc-f8a9-410a-a8f5-690a333d2bd2 admin admin] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:33:45.544824 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-a1eb02fc-f8a9-410a-a8f5-690a333d2bd2 admin admin] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:33:45.545257 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-a1eb02fc-f8a9-410a-a8f5-690a333d2bd2 admin admin] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:33:45.567705 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a1eb02fc-f8a9-410a-a8f5-690a333d2bd2 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079960 Oct 20 13:33:45.568180 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 38/76] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 20 13:33:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:34:43.904966 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: Thu Oct 20 13:34:43 2022 - graceful shutdown triggered... Oct 20 13:34:43.905446 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: Gracefully killing worker 2 (pid: 103951)... Oct 20 13:34:43.905091 dv-cinder-862136-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 20 13:34:43.906358 dv-cinder-862136-1-iscsi devstack@n-api.service[103950]: Gracefully killing worker 1 (pid: 103950)... Oct 20 13:34:44.033654 dv-cinder-862136-1-iscsi devstack@n-api.service[103951]: DEBUG dbcounter [-] [103951] Writing DB stats nova_api:SELECT=4 {{(pid=103951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:34:44.906125 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: worker 1 buried after 1 seconds Oct 20 13:34:44.906665 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: worker 2 buried after 1 seconds Oct 20 13:34:44.906665 dv-cinder-862136-1-iscsi devstack@n-api.service[103949]: goodbye to uWSGI. Oct 20 13:34:44.907705 dv-cinder-862136-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 20 13:34:44.908245 dv-cinder-862136-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 20 13:34:44.911099 dv-cinder-862136-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 20 13:34:44.921160 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 20 13:34:44.923721 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 20 13:34:44 2022] *** Oct 20 13:34:44.923901 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 20 13:34:44.924032 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 20 13:34:44.924152 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: nodename: dv-cinder-862136-1-iscsi Oct 20 13:34:44.924268 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: machine: x86_64 Oct 20 13:34:44.924379 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: clock source: unix Oct 20 13:34:44.924485 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: pcre jit disabled Oct 20 13:34:44.924594 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: detected number of CPU cores: 4 Oct 20 13:34:44.924701 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: current working directory: / Oct 20 13:34:44.924814 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: detected binary path: /usr/bin/uwsgi-core Oct 20 13:34:44.924962 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: your processes number limit is 47680 Oct 20 13:34:44.925082 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: your memory page size is 4096 bytes Oct 20 13:34:44.925192 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: detected max file descriptor number: 2048 Oct 20 13:34:44.925301 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: lock engine: pthread robust mutexes Oct 20 13:34:44.925585 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: thunder lock: enabled Oct 20 13:34:44.925765 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 20 13:34:44.925866 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 20 13:34:44.966333 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: Python main interpreter initialized at 0x55d51bc949c0 Oct 20 13:34:44.966333 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: python threads support enabled Oct 20 13:34:44.966333 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: your server socket listen backlog is limited to 100 connections Oct 20 13:34:44.966333 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: your mercy for graceful operations on workers is 90 seconds Oct 20 13:34:44.966751 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: mapped 403077 bytes (393 KB) for 2 cores Oct 20 13:34:44.966836 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: *** Operational MODE: preforking *** Oct 20 13:34:44.967055 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: *** uWSGI is running in multiple interpreter mode *** Oct 20 13:34:44.967055 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: spawned uWSGI master process (pid: 125425) Oct 20 13:34:44.967263 dv-cinder-862136-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 20 13:34:44.967835 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: spawned uWSGI worker 1 (pid: 125447, cores: 1) Oct 20 13:34:44.968287 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: spawned uWSGI worker 2 (pid: 125448, cores: 1) Oct 20 13:34:44.968607 dv-cinder-862136-1-iscsi devstack@n-api.service[125425]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 20 13:34:45.629878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 13:34:45.638623 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 13:34:46.785284 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:34:46.785284 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: from cryptography.utils import int_from_bytes Oct 20 13:34:46.785903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:34:46.785903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: from cryptography.utils import int_from_bytes Oct 20 13:34:46.831196 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:34:46.831196 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: from cryptography.utils import int_from_bytes Oct 20 13:34:46.831785 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:34:46.831785 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: from cryptography.utils import int_from_bytes Oct 20 13:34:49.186035 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 13:34:49.186569 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 13:34:49.189270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 13:34:49.189270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 13:34:49.189270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 13:34:49.189270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.189270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.189270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.189270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.189270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.189928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.189928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.190067 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.190355 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.190619 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.190940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.191274 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862136-1-iscsi {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.191942 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.191942 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.192185 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.192508 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.192819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.193173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.193644 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.193988 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.195921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.195921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.196137 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.196436 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.196763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.197105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.197433 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.197742 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.198072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.198388 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.198799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862136-1-iscsi {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.199121 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.199438 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.199752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.200175 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.200486 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.200807 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.201173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.201502 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.201798 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.202130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.202450 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.202776 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.203101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.203399 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.203711 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.204020 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.204344 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.204650 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.204984 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.205239 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.205629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.205861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.206183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.206511 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.206857 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.207008 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.207459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.207653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.207949 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.208256 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.208562 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.208887 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.209194 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.209499 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.209805 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.210112 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.210431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.211380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.211705 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.212110 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.212438 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.212849 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.213126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.213437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.213780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.214102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.214414 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.214736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.215061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.215370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.215678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.215985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.216306 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.216645 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.216977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.217233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.217540 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.217849 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.218170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.218479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.218787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.219095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.219399 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.219708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.220018 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.220325 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.220634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.220971 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.221279 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.221588 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.221897 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.222204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.222509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.222837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.223162 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.223470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.223777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.224085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.224395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.224719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.225053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.225362 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.225689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.225996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.226847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.227170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.227479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.227789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.231777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.231777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.231777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.231777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.231777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.231777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.231777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.231777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.232437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.232437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.232437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.232437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.232437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.232437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.232437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.232938 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.233025 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.233275 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.233985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.233985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.234266 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.234612 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.234932 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.235269 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.235605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.235926 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.236241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.236561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.236961 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.237227 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.237542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.237856 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.238288 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.238491 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.238826 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.239140 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.239458 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.239780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.240093 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.240413 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.240750 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.241101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.241415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.241916 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.242733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.243049 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.243379 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.243705 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.244049 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.244465 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.244640 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.245019 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.245336 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.245649 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.245971 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.246285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.246609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.246925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.247240 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.247549 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.247861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.248174 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.248520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.248841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.249205 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.249524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.249841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.250162 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.250479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.250799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.251111 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.251419 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.251723 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.252054 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.252336 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.252643 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.252989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.253324 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.253632 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.253981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.254648 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.254842 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.255154 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.255464 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.255770 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.256082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.256391 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.256697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.257052 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.257400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.258277 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.258604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.258912 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.259220 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.259541 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.259855 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.260167 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.260483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.260802 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.261157 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.261472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.261785 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.262199 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.262457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.262767 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.263095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.263421 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.263738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.264045 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.264356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.264666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.265018 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.265326 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.265634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.265939 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.266246 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.266551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.266855 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.267159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.267487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.267795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.268101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.268407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.268713 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.269084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.269392 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.269737 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.270077 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.270398 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.270728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.271043 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.271361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.271672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.271985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.272337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.272605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.272954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.273881 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.274205 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.274758 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.275160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.275318 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.275645 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.275955 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.276276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.276623 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.276988 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.277310 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.277638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.277951 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.278269 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.278580 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.278896 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.279208 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.279520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.279842 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.280156 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.280479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.280795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.281146 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.281462 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.281782 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.282088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.282475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.282733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.283067 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.283377 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.283690 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.284013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.284326 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.284641 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.284981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.285346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.285595 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.285905 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.286219 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.286532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.286841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.287148 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.287463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.287775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.288078 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.288380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.288736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.289237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.289556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.289883 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.290207 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.290514 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.290823 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.291151 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.291462 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.291769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.292076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.292383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.292730 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.293070 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.293378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.293698 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.294021 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.294332 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.294650 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.294959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.295334 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.295588 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.295896 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.296208 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.296519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.296832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.297171 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.297482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.297841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.298111 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.298421 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.298732 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.299038 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.299349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.299666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.300253 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.300590 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.300934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.301260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.301608 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.301930 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.302263 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.302593 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.302911 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.303215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.303528 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.303834 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.304142 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.304650 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.304993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.305539 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.305786 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.306013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.306319 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.306625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.306930 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.307238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.307556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.307878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.308174 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.308480 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.308806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.309142 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.309449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.309756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.310062 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.310405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.310712 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.311059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.311390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.311734 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.312040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.312346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.312671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.313003 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.313306 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.313611 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.313923 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.314231 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.314534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.314843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.315151 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.315459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.315769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.316071 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.316374 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.316676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.317011 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.317321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.317623 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.317926 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.318234 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.318540 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.318841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.319177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.319450 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.319763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.320608 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.320935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.321241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.321557 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.321866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.322170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.322453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 13:34:49.322879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.322980 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 13:34:49.323190 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.323190 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.323466 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 13:34:49.323612 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.323751 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 13:34:49.323883 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.324013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 13:34:49.324151 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.324283 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.324424 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.324563 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.324708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.324846 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.325012 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.325193 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.325328 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.325502 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.325635 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.325849 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.325984 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.326152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.326291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.326429 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.326562 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.326700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.326845 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.326984 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.327115 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.327256 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.327394 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.327562 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.327707 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862136-1-iscsi {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.327866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.328000 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.328169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.328313 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.328472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.328622 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.328795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.328948 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.329132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.329271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.329438 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.329586 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.329747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.329890 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.330052 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.330343 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.330507 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.330647 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.330787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.330958 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.331093 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.331272 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.331415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.331611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.331746 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.331926 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.332068 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.332239 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.332386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.332549 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.332681 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.332888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.333036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.333199 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.333396 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.333530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.333668 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.333799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.333946 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862136-1-iscsi {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.334084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.334211 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.334376 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.334521 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.334680 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.334824 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.335001 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.335202 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.335337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.335660 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.335878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.336113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.336347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.336480 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.336674 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.336816 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.336994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.337118 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.337304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.337438 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.337617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.337752 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.337927 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.338063 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.338238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.338371 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.338549 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.338701 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.338842 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.338973 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.339158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.339292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.339468 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.339601 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.339781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.339916 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.340093 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.340239 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.340401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.340545 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.340676 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.340811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.341001 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.341134 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.341306 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.341454 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.341632 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.341775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.341948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.342080 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.342216 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.342355 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.342485 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.342622 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.342753 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.342883 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.343052 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.343195 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.343388 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.343535 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.343674 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.343862 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.344010 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.344177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.344319 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.344488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.344630 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.344794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.344965 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.345132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.345281 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.345445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.345586 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.345764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.345897 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.346157 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.346299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.346442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.346578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.346719 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.346856 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.347015 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.347158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.347384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.347518 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.347663 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.347793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.347953 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.348087 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.348280 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.348422 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.348595 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.348739 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.348910 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.349054 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.349235 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.349385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.349540 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.349674 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.349846 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.349980 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.350151 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.350363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.350504 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.350645 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.350776 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.350912 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.351586 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.351743 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.351990 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.352295 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.352431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.352569 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.352708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.352854 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.353028 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.353160 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.353331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.353492 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.353657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.353800 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.353980 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.354120 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.354307 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.354448 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.354614 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.354756 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.354927 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.355060 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.355237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.355371 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.355561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.355703 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.355872 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.356011 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.356183 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.356407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.356552 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.356684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.356821 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.357001 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.357140 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.357271 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.357419 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.357550 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.357703 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.357837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.358026 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.358169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.358350 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.358484 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.358660 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.358801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.358969 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.359117 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.359278 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.359419 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.359588 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.359731 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.359911 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.360046 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.360221 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.360355 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.360530 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.360666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.360853 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.361022 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.361182 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.361315 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.361489 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.361631 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.361806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.361941 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.362115 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.362260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.362423 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.362583 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.362727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.362865 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.363023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.363166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.363328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.363463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.363644 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.363774 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.363949 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.364095 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.364254 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.364387 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.364559 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.364693 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.364913 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.365064 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.365196 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.365327 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.365463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.365602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.365770 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.365906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.366075 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.366209 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.366447 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.366591 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.366786 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.366929 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.367060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.367509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.367651 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.367823 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.367978 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.368140 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.368280 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.368455 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.368588 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.368781 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:34:49.368934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.369120 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.369255 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.369459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.369602 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.369792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.369934 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.370116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.370250 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.370429 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.370572 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.370751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.370886 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.371077 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.371211 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.371384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.371518 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.371696 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.371832 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.372007 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.372153 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.372314 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.372463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.372619 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.372757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.372935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.373080 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.373247 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.373397 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.373551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.373694 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.373855 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.373996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.374160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.374304 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.374483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.374625 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.374789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.374930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.375123 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.375305 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.375445 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.375585 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.375717 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.375847 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.375991 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.376123 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.376287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.376422 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.376642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.376785 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.376949 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.377091 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.377264 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.377405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.377577 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.377711 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.377905 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.378048 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.378225 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.378373 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.378542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.378690 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.378853 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.378995 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.379427 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.379562 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.379753 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.379902 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.380071 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.380206 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.380388 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.380522 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.380700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.380843 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.381041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.381187 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.381359 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.381491 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.381674 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.381817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.381990 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.382230 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.382885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.383150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.383472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.383712 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.383851 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.383990 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.384121 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.384260 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.384405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.384538 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.384692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.384826 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.385029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.385175 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.385344 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.385479 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.385657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.385801 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.385969 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.386103 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.386300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.386443 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.386697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.386851 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.386992 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.387132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.387264 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.387395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.387525 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.387662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.387827 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.387972 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.388157 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.388299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.388485 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.388619 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.388795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.388976 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.389225 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.389383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.389563 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.389740 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.389926 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.390101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.390252 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.390385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.390543 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.390761 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.390968 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.391102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.391239 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.391378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.391519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.391664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.391796 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.391927 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.392070 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.392202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.392384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.392532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.392698 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.392840 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.393037 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.393183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.393365 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.393501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.393675 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.393811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.393986 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.394120 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.394303 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.394439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.394618 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.394753 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.394933 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.395180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.395324 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.395501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.395636 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.395840 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.395983 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.396172 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.396309 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.396484 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.396623 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.396844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.397053 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.397197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.397336 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.397553 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.397687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.397808 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.397972 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.398229 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.398549 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.398683 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.398864 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.399015 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.399160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.399294 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.399475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.399606 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.399790 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.399933 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.400098 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.400243 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.400422 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.400565 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.400733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.400899 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.401081 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.401292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.401429 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.401644 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.401786 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.401970 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.402119 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.402278 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.402419 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.402607 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.402743 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.402922 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.403072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.403211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.403342 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.403526 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.403667 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.403834 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.403977 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.404141 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.404277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.404457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.404591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.404769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.404960 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.405095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.405234 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.405399 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.405542 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.405712 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.405855 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.406024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.406166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.406329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.406471 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.406639 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.406783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.407029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.407165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.407303 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.407441 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.407585 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.407722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.407852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.407990 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.408120 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.408257 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.408433 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.408566 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.408739 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.408903 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.409066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.409362 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.409513 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.409653 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.409785 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.409914 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.410051 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.410190 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.410322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.410451 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.410589 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.410733 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.410919 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.411063 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.411196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.411410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.411554 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.411745 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.411894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.412063 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.412200 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.412369 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.412503 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.412676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.412820 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.413006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.413151 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.413320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.413452 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.414160 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.414381 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.414646 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.415041 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.415186 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.415360 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.415493 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.415688 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.415820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.416007 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.416156 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.416338 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.416541 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.416689 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.416897 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.417304 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.417437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.417568 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.417788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.417932 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.418055 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.418198 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.418331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.418462 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.418607 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.418875 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.419012 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.419143 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.419274 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.419413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.419559 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.419702 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.419836 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.419974 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.420113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.420258 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.420391 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.420529 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.420661 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.420791 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.420965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.421110 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.421240 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.421473 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.421624 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.421758 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.421902 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.422035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.422173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.422313 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.422452 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.422601 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.422741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.422862 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.422993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.423124 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.423262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.423407 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.423539 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.423678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.423895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.424039 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.424209 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.424352 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.424530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.424672 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.424847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.425034 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.425185 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.425326 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.425486 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.425629 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.425796 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.425930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.426106 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.426242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.426413 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.426548 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.426720 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.426853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.427027 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.427598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.427598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.427846 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.427986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.428107 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.428107 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.428365 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.428505 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.428644 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.428776 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.428958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.429095 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.429307 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.429930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.430070 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.430321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.430542 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.430688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.430853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.430995 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.431176 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.431313 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.431489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.431633 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.431802 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.431944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.432121 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.432266 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.432439 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.432577 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.432757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.432937 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.433102 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.433248 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.433409 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.433544 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.433715 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.433859 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.434026 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.434175 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.434339 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.434472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.434647 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.434782 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.434954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.435099 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.435261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.435389 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.435571 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.435830 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.435978 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.436212 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.436355 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.436499 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.436634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.436765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.436963 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.437104 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.437243 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.437376 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.437520 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.437756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.437892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.438024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.438166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.438312 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.438445 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.438576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.438708 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.438840 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.439013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.439152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.439325 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.439461 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.439636 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.439782 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.439952 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.440108 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.440250 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.440384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.440556 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.440706 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.440848 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.441025 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.441189 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.441325 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.441498 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.441641 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.441787 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.441929 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.442096 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.442237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.442404 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.442548 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.442722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.442860 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.443029 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.443164 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.443343 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.443479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.443650 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.443799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.443973 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.444108 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.444282 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.444422 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.444591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.444735 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.444949 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.445212 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.445579 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.445579 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.446041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.446181 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.446474 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.446609 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.446802 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.446948 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.447110 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.447260 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.447438 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.447595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.447747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.447969 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.448106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.448277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.448413 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.448592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.448743 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.448927 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.449077 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.449262 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.449399 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.449575 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.449721 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.449893 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.450029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.450204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.450339 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.450517 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.450662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.450829 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.450963 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.451137 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.451272 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.451448 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.451591 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.451760 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.451896 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.452072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.452204 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.452380 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.452524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.452684 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.452820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.453022 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.453159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.453330 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.453475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.453648 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.453784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.453962 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.454098 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.454271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.454416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.454577 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.454719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.454889 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.455033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.455200 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.455337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.455506 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.455643 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.455817 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.455967 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.456099 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 13:34:49.456237 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.456429 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.456735 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.457067 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.457378 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.457687 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.457996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.458303 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.458631 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.458946 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.459255 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.459568 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.459878 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.460188 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.460554 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.461369 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.461709 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.462035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.462349 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.462666 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.462978 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.463291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.463602 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.463915 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.464223 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.464529 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.464835 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.465168 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.465476 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.465801 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.466112 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.466421 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.466730 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.467037 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.467385 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.467695 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.468058 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.468371 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.468689 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.469035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.469353 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.469672 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.469989 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.470298 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.470614 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.470942 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.471246 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.471555 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.471864 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.472191 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.472506 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.472819 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.473170 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.473496 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.473823 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.474132 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.474443 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.474756 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.475068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.475382 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.475695 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.476008 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.477307 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.477637 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.477961 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.478284 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.478598 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.478919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.479236 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.479549 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.479883 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.480198 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.480519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.480832 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.481166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.481483 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.481795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.482232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.482548 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.482861 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.483169 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.483478 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.483812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.484117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.484436 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.484743 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.485194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.485510 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.485826 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.486142 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.486450 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.486756 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.487071 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.487399 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.487707 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.488013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.488322 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.488653 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.488983 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.489311 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.489732 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.490050 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.490356 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.490776 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.491090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.491404 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.491810 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.493153 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.493501 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.493821 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.494149 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.494470 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.498508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.498508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.498508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.498508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.498508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.498508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.498508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.498508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.499628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.499628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.499628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.499628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.499628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.499628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.499628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.499628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.500640 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.500640 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.500640 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.501051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.501189 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.501445 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.501760 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.502074 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.502383 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.502691 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.503018 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.503329 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.503658 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.503982 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.504564 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.504909 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.505224 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.505552 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.505865 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.506173 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.506482 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.506790 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.507137 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.507685 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.508363 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.508705 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.509076 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.509395 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.510196 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.510196 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.510376 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.510676 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.510999 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.511330 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.511639 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.511949 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.512264 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.512569 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.512898 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.513210 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.513525 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.513833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.514142 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.514450 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.514777 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.515085 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.515413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.515726 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.516035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.516345 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.516652 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.517032 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.517341 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.517676 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.517990 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.518124 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO dbcounter [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Registered counter for database nova_api Oct 20 13:34:49.518318 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.518640 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.518961 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.519279 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.519599 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.520049 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.520237 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.520557 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.520915 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.521227 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.521528 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.521849 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.522410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.522746 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.523547 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.523881 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.524204 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.524529 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.524853 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.525196 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.525518 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.525839 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.526156 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.526490 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.526819 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.527152 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.527490 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.527815 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.528136 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.528454 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.528773 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.529162 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.529482 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.529794 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.530122 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.530444 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.530761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.531075 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.531388 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.531707 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.532035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.532352 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.532648 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.533083 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.533405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.533769 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.534072 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.534395 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.534727 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.535032 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.535361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.535888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.536225 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.536548 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.536903 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.537231 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.537552 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.537872 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.538293 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.539118 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.539319 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_db.sqlalchemy.engines [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:34:49.539934 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.540271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.540590 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.540925 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.541260 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.541582 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.541898 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.542225 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.542541 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.543091 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.543451 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.543782 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.544104 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.544436 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.544756 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.545093 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.545423 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.545736 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.546046 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.546364 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.546680 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.546825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writer thread running {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:34:49.546988 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.547296 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.547611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.547924 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.548232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.548544 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.548851 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.549204 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.549820 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.550135 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.550449 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.550756 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.551062 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.551370 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.551675 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.551989 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.552297 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.552608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.552947 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.553264 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.553622 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.553934 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.554319 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.555099 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.555417 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.555733 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.556064 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.556384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.556714 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.557062 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.557383 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.557736 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.558061 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.558605 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.558946 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.559273 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.559612 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.559953 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.560266 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.560576 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.560909 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.561246 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.561563 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.561881 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.562197 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.562514 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.562829 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.563143 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.563456 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.563771 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.564084 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.564396 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.564709 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.565048 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.565363 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.565677 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.565996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.566340 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.566664 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.566985 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.567304 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.567624 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.567938 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.568253 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.568565 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.568897 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.569224 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.569555 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.569942 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.570697 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.571146 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.571472 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.571802 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.572131 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.572447 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.572777 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.573144 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.573462 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.573788 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.574104 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.574441 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.574788 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.575125 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.575457 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.575767 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.576078 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.576387 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.576700 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.577051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.577369 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.577677 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.577985 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.578298 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.578607 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.578914 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.579222 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.579532 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.579849 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.580154 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.580460 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.580766 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.581097 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.581405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.581716 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.582028 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.582334 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.582638 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.582943 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.583251 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.583553 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.583888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.584228 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.584547 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.584892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.585214 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.586168 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.586837 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.587178 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.587514 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.587844 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.588163 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.588508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.588828 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.589174 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.589495 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.589818 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.590141 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.590458 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.590794 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.591128 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.591441 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.591774 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.592099 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.592425 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.592744 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.593087 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.593425 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.593743 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.594059 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.594373 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.594690 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.595005 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.595326 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.595641 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.595956 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.596276 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.596595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.596949 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.597282 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.597595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.597924 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.598254 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.598603 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.598918 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.599270 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.599608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.599929 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.600251 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.600566 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:34:49.600813 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 13:34:49.603907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.context [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f1966287-b3a3-4c20-97b3-61dda7e72f23(cell1) {{(pid=125448) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 13:34:49.607975 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:34:49.608448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:34:49.610060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:34:49.610782 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:34:49.611291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:34:49.613283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:34:49.615299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO dbcounter [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Registered counter for database nova_cell0 Oct 20 13:34:49.619918 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO dbcounter [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Registered counter for database nova_cell1 Oct 20 13:34:49.627068 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_db.sqlalchemy.engines [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:34:49.629462 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_db.sqlalchemy.engines [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:34:49.635135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writer thread running {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:34:49.641068 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writer thread running {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:34:49.666227 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO dbcounter [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Registered counter for database nova_api Oct 20 13:34:49.687927 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_db.sqlalchemy.engines [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:34:49.694574 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writer thread running {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:34:49.753312 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.context [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f1966287-b3a3-4c20-97b3-61dda7e72f23(cell1) {{(pid=125447) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 13:34:49.758281 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:34:49.758762 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:34:49.760381 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:34:49.761164 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:34:49.761612 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:34:49.763641 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:34:49.765756 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO dbcounter [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Registered counter for database nova_cell0 Oct 20 13:34:49.770249 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO dbcounter [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Registered counter for database nova_cell1 Oct 20 13:34:49.779685 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_db.sqlalchemy.engines [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:34:49.782979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_db.sqlalchemy.engines [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:34:49.787176 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writer thread running {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:34:49.790535 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO dbcounter [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Registered counter for database nova_cell0 Oct 20 13:34:49.797379 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_db.sqlalchemy.engines [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:34:49.802272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writer thread running {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:34:49.931831 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writer thread running {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:34:49.941383 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO dbcounter [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Registered counter for database nova_cell0 Oct 20 13:34:49.950241 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_db.sqlalchemy.engines [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:34:49.954802 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writer thread running {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:34:50.127617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: WARNING keystonemiddleware.auth_token [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 13:34:50.135457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: WARNING keystonemiddleware.auth_token [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 13:34:50.275947 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: WARNING keystonemiddleware.auth_token [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 13:34:50.283446 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: WARNING keystonemiddleware.auth_token [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 13:34:50.481277 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: WARNING keystonemiddleware.auth_token [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 13:34:50.487784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: WARNING keystonemiddleware.auth_token [None req-fb390611-7f4c-4758-941b-9deb7777112c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 13:34:50.494475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d51bc949c0 pid: 125448 (default app) Oct 20 13:34:50.628523 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: WARNING keystonemiddleware.auth_token [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 13:34:50.635355 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: WARNING keystonemiddleware.auth_token [None req-455e024d-4eae-469f-a8fd-a71e8d29f583 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 13:34:50.640703 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d51bc949c0 pid: 125447 (default app) Oct 20 13:35:25.184563 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=3 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:25.186036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=3 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:25.186996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=3 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:25.187906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=3 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:26.249534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-050d1b99-51c0-48fb-bbd8-a7a4d34674ff tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Action: 'create', calling method: .version_select at 0x7ffa13db1b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1361439758", "metadata": {"Type": "work"}}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-050d1b99-51c0-48fb-bbd8-a7a4d34674ff tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Request method failure captured: Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 122 Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6dXbynrlAyCW-9J4NrTTU3e-LNlMrwb5cFmlsOtNpaaTfSh7nH65Lvf2dG_3j5ZktLS2gUtdPPUcBph5UtvDH5tnVuJ_RqGyjrV1PCrJQ2udDNwEJ3-zQbMfD4W3fteimvpNMG4qxohtzGfv4dW0JinM2N3sx5r7QVCsePHzvGtX0 Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:35:26.260395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 47ea84f99dc2419581cf8fa21e26f823 Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1361439758", "metadata": {"Type": "work"}}} Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: Oct 20 13:35:26.261982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1361439758', 'metadata': {'Type': 'work'}}}} Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise error Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi '#$%' Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:35:26.262934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 20 13:35:26.264469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 20 13:35:26.266064 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 20 13:35:26.266064 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.267468 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-050d1b99-51c0-48fb-bbd8-a7a4d34674ff tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:35:26.268613 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-050d1b99-51c0-48fb-bbd8-a7a4d34674ff tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.094042 Oct 20 13:35:26.275017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 20 13:35:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 13:35:26.542247 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e7cae015-8a22-43a0-8c44-ac0aea6a8fdd tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Action: 'create', calling method: .version_select at 0x7ffa13e60670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1892282425", "metadata": {"Type": "work"}}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e7cae015-8a22-43a0-8c44-ac0aea6a8fdd tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Request method failure captured: Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 120 Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6dXbynrlAyCW-9J4NrTTU3e-LNlMrwb5cFmlsOtNpaaTfSh7nH65Lvf2dG_3j5ZktLS2gUtdPPUcBph5UtvDH5tnVuJ_RqGyjrV1PCrJQ2udDNwEJ3-zQbMfD4W3fteimvpNMG4qxohtzGfv4dW0JinM2N3sx5r7QVCsePHzvGtX0 Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:35:26.548226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 47ea84f99dc2419581cf8fa21e26f823 Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1892282425", "metadata": {"Type": "work"}}} Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: Oct 20 13:35:26.549511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1892282425', 'metadata': {'Type': 'work'}}}} Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise error Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi '0' Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:35:26.550410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 20 13:35:26.551761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 20 13:35:26.554916 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 20 13:35:26.554916 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.554916 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e7cae015-8a22-43a0-8c44-ac0aea6a8fdd tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:35:26.554916 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e7cae015-8a22-43a0-8c44-ac0aea6a8fdd tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.273302 Oct 20 13:35:26.554916 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 20 13:35:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 13:35:26.562516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a21f63b8-2add-4648-a4db-dd2ebe5327d4 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Action: 'create', calling method: .version_select at 0x7ffa13dc4430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-633523692", "metadata": {"Type": "work"}}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a21f63b8-2add-4648-a4db-dd2ebe5327d4 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Request method failure captured: Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 118 Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6dXbynrlAyCW-9J4NrTTU3e-LNlMrwb5cFmlsOtNpaaTfSh7nH65Lvf2dG_3j5ZktLS2gUtdPPUcBph5UtvDH5tnVuJ_RqGyjrV1PCrJQ2udDNwEJ3-zQbMfD4W3fteimvpNMG4qxohtzGfv4dW0JinM2N3sx5r7QVCsePHzvGtX0 Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:35:26.566708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 47ea84f99dc2419581cf8fa21e26f823 Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-633523692", "metadata": {"Type": "work"}}} Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: Oct 20 13:35:26.567952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-633523692', 'metadata': {'Type': 'work'}}}} Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise error Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi '' Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:35:26.568817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 20 13:35:26.570130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 20 13:35:26.571260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 20 13:35:26.571260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:35:26.571260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a21f63b8-2add-4648-a4db-dd2ebe5327d4 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:35:26.571260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a21f63b8-2add-4648-a4db-dd2ebe5327d4 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010492 Oct 20 13:35:26.571260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 20 13:35:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 13:35:26.575596 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=3 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:26.576664 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=3 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:26.577449 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=3 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:26.578172 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=3 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:26.583463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-420db09d-db75-40e9-a78c-f7e74df6fb43 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Calling method '.version_select at 0x7ffa13df3ee0>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:27.443962 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-71b14bc8-3f12-429a-a616-b40cce494d45 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13c6c820>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:27.764187 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-420db09d-db75-40e9-a78c-f7e74df6fb43 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] HTTP exception thrown: Volume tempest-invalid-866060060 could not be found. Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-420db09d-db75-40e9-a78c-f7e74df6fb43 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Request method failure captured: Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-866060060 HTTP/1.1 Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 0 Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6dXbynrlAyCW-9J4NrTTU3e-LNlMrwb5cFmlsOtNpaaTfSh7nH65Lvf2dG_3j5ZktLS2gUtdPPUcBph5UtvDH5tnVuJ_RqGyjrV1PCrJQ2udDNwEJ3-zQbMfD4W3fteimvpNMG4qxohtzGfv4dW0JinM2N3sx5r7QVCsePHzvGtX0 Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:35:27.768073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 47ea84f99dc2419581cf8fa21e26f823 Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Volume tempest-invalid-866060060 could not be found. Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'id': 'tempest-invalid-866060060'} Oct 20 13:35:27.769578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-866060060 could not be found. (HTTP 404) (Request-ID: req-93e0bd98-9a39-49a8-8c0f-1399460a64ba) Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:27.770346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 13:35:27.771581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-866060060 could not be found. Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:35:27.773440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-866060060 could not be found. Oct 20 13:35:27.774592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.774592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:27.774592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.774592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:27.774592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:27.774592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:27.774592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:35:27.774592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:35:27.774592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-866060060 could not be found. Oct 20 13:35:27.774592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.776845 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-420db09d-db75-40e9-a78c-f7e74df6fb43 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Returning 404 to user: Volume tempest-invalid-866060060 could not be found. {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:35:27.777994 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-420db09d-db75-40e9-a78c-f7e74df6fb43 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-866060060" status: 404 len: 98 microversion: 2.1 time: 1.203338 Oct 20 13:35:27.778615 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Oct 20 13:35:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-866060060 => generated 98 bytes in 1205 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 20 13:35:27.789239 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-be2a4f61-c671-40e2-ba2a-ac0e7fedcac9 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005196 Oct 20 13:35:27.790593 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Oct 20 13:35:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 20 13:35:27.808810 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-87a328ef-3c59-4f05-af6a-aab1ad6d0fbb tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010548 Oct 20 13:35:27.810061 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 4/6] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 20 13:35:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 20 13:35:27.822624 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a8784704-e754-4b88-9a88-a84e4a666ff7 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Calling method '.version_select at 0x7ffa13b959d0>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:27.913839 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-a8784704-e754-4b88-9a88-a84e4a666ff7 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] HTTP exception thrown: Volume d94553ad-d49b-4119-9b49-4333c7a1bafd could not be found. Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a8784704-e754-4b88-9a88-a84e4a666ff7 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Request method failure captured: Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: DELETE /compute/v2.1/os-volumes/d94553ad-d49b-4119-9b49-4333c7a1bafd HTTP/1.1 Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 0 Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6dXbynrlAyCW-9J4NrTTU3e-LNlMrwb5cFmlsOtNpaaTfSh7nH65Lvf2dG_3j5ZktLS2gUtdPPUcBph5UtvDH5tnVuJ_RqGyjrV1PCrJQ2udDNwEJ3-zQbMfD4W3fteimvpNMG4qxohtzGfv4dW0JinM2N3sx5r7QVCsePHzvGtX0 Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:35:27.915812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 47ea84f99dc2419581cf8fa21e26f823 Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Volume d94553ad-d49b-4119-9b49-4333c7a1bafd could not be found. Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'id': 'd94553ad-d49b-4119-9b49-4333c7a1bafd'} Oct 20 13:35:27.917114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d94553ad-d49b-4119-9b49-4333c7a1bafd could not be found. (HTTP 404) (Request-ID: req-badd5210-1e0e-41ad-a7da-11d123796cf1) Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:27.917879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 13:35:27.918950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d94553ad-d49b-4119-9b49-4333c7a1bafd could not be found. Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 20 13:35:27.920020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d94553ad-d49b-4119-9b49-4333c7a1bafd could not be found. Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d94553ad-d49b-4119-9b49-4333c7a1bafd could not be found. Oct 20 13:35:27.921117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:27.923551 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a8784704-e754-4b88-9a88-a84e4a666ff7 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Returning 404 to user: Volume d94553ad-d49b-4119-9b49-4333c7a1bafd could not be found. {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:35:27.925513 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a8784704-e754-4b88-9a88-a84e4a666ff7 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/d94553ad-d49b-4119-9b49-4333c7a1bafd" status: 404 len: 109 microversion: 2.1 time: 0.109020 Oct 20 13:35:27.927244 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 5/7] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 20 13:35:27 2022] DELETE /compute/v2.1/os-volumes/d94553ad-d49b-4119-9b49-4333c7a1bafd => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:35:27.939018 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f997dcc7-c0af-4aeb-912c-84166bbe4ba4 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Calling method '.version_select at 0x7ffa13b95d30>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:28.037930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-f997dcc7-c0af-4aeb-912c-84166bbe4ba4 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] HTTP exception thrown: Volume 39a04c95-226c-4b06-8335-eb21a1aa41f8 could not be found. Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f997dcc7-c0af-4aeb-912c-84166bbe4ba4 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Request method failure captured: Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: GET /compute/v2.1/os-volumes/39a04c95-226c-4b06-8335-eb21a1aa41f8 HTTP/1.1 Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 0 Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6dXbynrlAyCW-9J4NrTTU3e-LNlMrwb5cFmlsOtNpaaTfSh7nH65Lvf2dG_3j5ZktLS2gUtdPPUcBph5UtvDH5tnVuJ_RqGyjrV1PCrJQ2udDNwEJ3-zQbMfD4W3fteimvpNMG4qxohtzGfv4dW0JinM2N3sx5r7QVCsePHzvGtX0 Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:35:28.040384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d4302a426b84e7696c67066b62c1fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: 3d4302a426b84e7696c67066b62c1fee Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-VolumesNegativeTest-1079376139 Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 47ea84f99dc2419581cf8fa21e26f823 Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-VolumesNegativeTest-1079376139-project Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Volume 39a04c95-226c-4b06-8335-eb21a1aa41f8 could not be found. Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'id': '39a04c95-226c-4b06-8335-eb21a1aa41f8'} Oct 20 13:35:28.041930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 39a04c95-226c-4b06-8335-eb21a1aa41f8 could not be found. (HTTP 404) (Request-ID: req-34726310-f7a2-4a46-a9b7-975d632592d6) Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:28.042850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 13:35:28.044165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 39a04c95-226c-4b06-8335-eb21a1aa41f8 could not be found. Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 13:35:28.047291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 39a04c95-226c-4b06-8335-eb21a1aa41f8 could not be found. Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 39a04c95-226c-4b06-8335-eb21a1aa41f8 could not be found. Oct 20 13:35:28.049608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:35:28.051939 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f997dcc7-c0af-4aeb-912c-84166bbe4ba4 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] Returning 404 to user: Volume 39a04c95-226c-4b06-8335-eb21a1aa41f8 could not be found. {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:35:28.053298 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-f997dcc7-c0af-4aeb-912c-84166bbe4ba4 tempest-VolumesNegativeTest-1079376139 tempest-VolumesNegativeTest-1079376139-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/39a04c95-226c-4b06-8335-eb21a1aa41f8" status: 404 len: 109 microversion: 2.1 time: 0.119994 Oct 20 13:35:28.054543 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 6/8] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:35:27 2022] GET /compute/v2.1/os-volumes/39a04c95-226c-4b06-8335-eb21a1aa41f8 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:35:28.492085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-71b14bc8-3f12-429a-a616-b40cce494d45 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/73901eae-c540-41fb-872d-e5c6916555ef" status: 200 len: 351 microversion: 2.1 time: 1.052921 Oct 20 13:35:28.492990 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 3/9] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:35:27 2022] GET /compute/v2.1/os-volumes/73901eae-c540-41fb-872d-e5c6916555ef => generated 351 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:35:30.508125 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-77162459-2afa-49f0-99b7-f9baf7420311 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13b95310>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:30.644290 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-77162459-2afa-49f0-99b7-f9baf7420311 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/0c82d793-8f8a-4c6e-bc3d-d8b96a27a1d9" status: 200 len: 349 microversion: 2.1 time: 0.140583 Oct 20 13:35:30.645017 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 7/10] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:35:30 2022] GET /compute/v2.1/os-volumes/0c82d793-8f8a-4c6e-bc3d-d8b96a27a1d9 => generated 349 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:35:32.688412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-95f0c9b9-89ce-494b-be47-63e119efd05b tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13c48f70>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:32.780449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-95f0c9b9-89ce-494b-be47-63e119efd05b tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a66f52f2-b7eb-4ac2-bdf1-9734c3746062" status: 200 len: 349 microversion: 2.1 time: 0.097392 Oct 20 13:35:32.781362 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 4/11] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:35:32 2022] GET /compute/v2.1/os-volumes/a66f52f2-b7eb-4ac2-bdf1-9734c3746062 => generated 349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:35:32.795504 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9fc24b17-7691-4dea-b6bd-59f783bbefcd tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13ba23a0>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:33.017954 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9fc24b17-7691-4dea-b6bd-59f783bbefcd tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.226804 Oct 20 13:35:33.019310 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 8/12] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Oct 20 13:35:32 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:33.034241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8127a78c-26cf-4fe4-a643-fc8f10fbfa64 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13c6c820>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:33.317046 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8127a78c-26cf-4fe4-a643-fc8f10fbfa64 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.287257 Oct 20 13:35:33.317606 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 5/13] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 20 13:35:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 691 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:35:33.333104 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b31c1a07-30fe-47f8-822d-f89f375939b0 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13b95a60>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:33.597772 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b31c1a07-30fe-47f8-822d-f89f375939b0 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.269387 Oct 20 13:35:33.598940 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 9/14] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Oct 20 13:35:33 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:33.613192 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cc96dd75-0e62-4e00-a2fe-c0cf7dea98cc tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13bd8310>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:33.868549 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cc96dd75-0e62-4e00-a2fe-c0cf7dea98cc tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.259450 Oct 20 13:35:33.872385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 6/15] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Oct 20 13:35:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:35:33.883765 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-285030ac-5d44-4c26-b15a-0867f46c2580 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13ba13a0>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:34.166552 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-285030ac-5d44-4c26-b15a-0867f46c2580 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.287486 Oct 20 13:35:34.168944 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 10/16] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Oct 20 13:35:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 691 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:35:34.188997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-bebc0a14-6efa-4762-8ed3-44c543ef09dd tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13bd8b80>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:34.498934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-bebc0a14-6efa-4762-8ed3-44c543ef09dd tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.319588 Oct 20 13:35:34.499730 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 7/17] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 20 13:35:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:34.515170 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-fc39dd79-f0e8-4bde-b86a-4df623184a23 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13b9f700>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:34.932606 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-fc39dd79-f0e8-4bde-b86a-4df623184a23 tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.422140 Oct 20 13:35:34.947824 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b8fec431-5d4c-4b2b-a9bd-9ca6e10b096d tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] Calling method '.version_select at 0x7ffa13bd4790>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:34.953023 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 11/18] 10.222.0.23 () {58 vars in 1188 bytes} [Thu Oct 20 13:35:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:35:35.388502 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b8fec431-5d4c-4b2b-a9bd-9ca6e10b096d tempest-VolumesTestJSON-1661463710 tempest-VolumesTestJSON-1661463710-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.444234 Oct 20 13:35:35.389736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 8/19] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 20 13:35:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:41.347018 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-beae12d2-a93e-465b-a044-5ff6e5ccd7d5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: .version_select at 0x7ffa13ba1280>, body: {"keypair": {"name": "tempest-keypair-1884063730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHBt477mM8TXF7/I1JjrF+tkjowa5faynskRUuS97b9qV+IKEM8L0tYQB8wU13XTtR9RvS8kgZeeVvg4nqQHP8veRgr1l3xRglZw9oVQvs8jvA7fx+wd6Z03eEPmxwqgg=="}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:35:41.462800 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-beae12d2-a93e-465b-a044-5ff6e5ccd7d5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for project b215cb88123a4851932dbf7dfa88f709. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:35:41.476535 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-beae12d2-a93e-465b-a044-5ff6e5ccd7d5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for user 144e9801ac1f470083d11647652ccdf1 and project b215cb88123a4851932dbf7dfa88f709. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:35:41.574909 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-beae12d2-a93e-465b-a044-5ff6e5ccd7d5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.463086 Oct 20 13:35:41.576129 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 12/20] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 20 13:35:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:35:43.085107 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-29fddba7-c69b-483f-8971-b418d622080b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'create', calling method: .version_select at 0x7ffa13bde700>, body: {"keypair": {"name": "tempest-keypair-919390858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY67dz+4FMb6HrzxTKCCeA//1kQWtm3C0jREWM2uzj8Jp+DztmHUjBn7YH/tfifWnHSPS4Ff8qE0RUh/DSqS+ucBvYoB2Ca3NhUrw9nqWw0POcFhKcRKV5zWpZd7P8gIA=="}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:35:43.225750 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-29fddba7-c69b-483f-8971-b418d622080b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Getting quotas for project 747a468811fb478aa6c49b848ccee6d0. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:35:43.225750 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-29fddba7-c69b-483f-8971-b418d622080b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Getting quotas for user fe56d1d4278c43cd96a39f7f75f373b8 and project 747a468811fb478aa6c49b848ccee6d0. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:35:43.345922 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-29fddba7-c69b-483f-8971-b418d622080b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.810273 Oct 20 13:35:43.348217 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 9/21] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 20 13:35:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:35:46.944489 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-1bd7338c-56f1-44f6-981f-6ab993f18564 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Action: 'create', calling method: .version_select at 0x7ffa13b70670>, body: {"keypair": {"name": "tempest-keypair-799321792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKBg3PlXM1UIJFZtnE91qr+O/DgorSM1wMVBSY4z5R33L8OBSvZfxVnMQPMfSvGPXcpSDK7tB5TJqMYrN4VtC08R+jHZ8dW7tJJqWcW6DNcDBcE7l4q/rR3cukoWPFL5w=="}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:35:46.978123 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-1bd7338c-56f1-44f6-981f-6ab993f18564 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Getting quotas for project f9addc326c51410f809805d8b44c5c17. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:35:46.982702 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-1bd7338c-56f1-44f6-981f-6ab993f18564 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Getting quotas for user 55526ddbea014e6cbf7c079cb204059e and project f9addc326c51410f809805d8b44c5c17. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:35:47.019764 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-1bd7338c-56f1-44f6-981f-6ab993f18564 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.754155 Oct 20 13:35:47.022115 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 13/22] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 20 13:35:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 756 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 20 13:35:47.815593 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1095049293", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "networks": [{"uuid": "d74e8eea-b10e-43ce-b0cb-8741f1110868"}]}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:35:48.064682 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.network.neutron [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] validate_networks() for [('d74e8eea-b10e-43ce-b0cb-8741f1110868', None, None, None, None, None)] {{(pid=125448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:35:48.332840 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-602752490", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d308b555-e032-40ef-ae84-228dba4540e0"}], "security_groups": [{"name": "tempest-securitygroup--1742222953"}], "key_name": "tempest-keypair-919390858", "user_data": "}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:35:48.750973 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.network.neutron [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] validate_networks() for [('d308b555-e032-40ef-ae84-228dba4540e0', None, None, None, None, None)] {{(pid=125447) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:35:50.362412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Flavor limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:35:50.365080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Image limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:35:50.365852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Flavor pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:35:50.366397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Image pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:35:50.366950 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:35:50.391979 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:50.392646 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:50.393300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:50.397668 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:50.398373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:50.398979 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:50.470459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Getting quotas for project 4e1ecd40d6914036b80dfcf74eada323. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:35:50.480145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Getting quotas for user 6085945ca3304bc99b4d9ca8a37d5319 and project 4e1ecd40d6914036b80dfcf74eada323. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:35:50.514522 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Going to run 1 instances... {{(pid=125448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:35:50.517893 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:35:50.572224 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Flavor limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:35:50.572771 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Image limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:35:50.573584 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Flavor pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:35:50.574207 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Image pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:35:50.574880 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:35:50.597687 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:50.599031 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:50.600741 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:50.601923 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:50.602662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:50.603282 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:50.727807 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-593eb991-ed32-4c9e-94b4-296d77f88873 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.104782 Oct 20 13:35:50.735925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 10/23] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:35:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 13:35:50.743225 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Getting quotas for project 747a468811fb478aa6c49b848ccee6d0. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:35:50.750012 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1392640278", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a87efad-1518-4319-8b6e-3edd28303f86"}], "security_groups": [{"name": "tempest-securitygroup--1994652214"}], "key_name": "tempest-keypair-1884063730", "user_data": "}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:35:50.758100 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Getting quotas for user fe56d1d4278c43cd96a39f7f75f373b8 and project 747a468811fb478aa6c49b848ccee6d0. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:35:50.783733 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Going to run 1 instances... {{(pid=125447) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:35:50.792730 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125447) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:35:51.012725 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.network.neutron [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] validate_networks() for [('6a87efad-1518-4319-8b6e-3edd28303f86', None, None, None, None, None)] {{(pid=125448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:35:51.034072 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-45d6f3a0-be0f-44f9-8368-deec4e1d6d6b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.707047 Oct 20 13:35:51.034725 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 14/24] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:35:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 13:35:51.057872 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3eae7cc9-df42-413a-8afe-37dfafbdd60a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:51.058504 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3eae7cc9-df42-413a-8afe-37dfafbdd60a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:51.339204 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3eae7cc9-df42-413a-8afe-37dfafbdd60a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:51.373828 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3eae7cc9-df42-413a-8afe-37dfafbdd60a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1215 microversion: 2.1 time: 0.328210 Oct 20 13:35:51.374641 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 15/25] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:51 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1215 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:51.385063 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b33bddb6-c544-4f40-b26d-423ca35fc331 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:51.385843 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b33bddb6-c544-4f40-b26d-423ca35fc331 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:51.483579 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b33bddb6-c544-4f40-b26d-423ca35fc331 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:51.495631 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b33bddb6-c544-4f40-b26d-423ca35fc331 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1236 microversion: 2.1 time: 0.119786 Oct 20 13:35:51.497839 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 16/26] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:51 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1236 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:51.631573 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1667415010", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c859482-bc24-4f85-8ad7-70cfdb97a23e"}], "security_groups": [{"name": "tempest-securitygroup--479809682"}], "key_name": "tempest-keypair-799321792", "user_data": "}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:35:51.900346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.network.neutron [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] validate_networks() for [('9c859482-bc24-4f85-8ad7-70cfdb97a23e', None, None, None, None, None)] {{(pid=125447) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:35:52.087767 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Flavor limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:35:52.088993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Image limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:35:52.089871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Flavor pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:35:52.090662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Image pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:35:52.091283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:35:52.102984 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:52.103959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:52.105158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:52.106547 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:52.107235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:52.107869 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:52.185640 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for project b215cb88123a4851932dbf7dfa88f709. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:35:52.197790 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for user 144e9801ac1f470083d11647652ccdf1 and project b215cb88123a4851932dbf7dfa88f709. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:35:52.226739 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Going to run 1 instances... {{(pid=125448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:35:52.229155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:35:52.318266 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-118360d7-7cd7-42e4-8ae0-624b05a0f839 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.580176 Oct 20 13:35:52.320384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 11/27] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:35:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 13:35:52.336289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7b3bdb63-a8bd-4804-b9d2-3ce76eaa370f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:52.337719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7b3bdb63-a8bd-4804-b9d2-3ce76eaa370f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:52.643590 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7b3bdb63-a8bd-4804-b9d2-3ce76eaa370f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:52.693328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7b3bdb63-a8bd-4804-b9d2-3ce76eaa370f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1242 microversion: 2.1 time: 0.363967 Oct 20 13:35:52.699903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 12/28] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:52 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1242 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:35:52.715625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cbe4c576-253d-4921-b820-77f7c8ef74d9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:52.728029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cbe4c576-253d-4921-b820-77f7c8ef74d9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:52.887938 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cbe4c576-253d-4921-b820-77f7c8ef74d9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:52.905440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cbe4c576-253d-4921-b820-77f7c8ef74d9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1215 microversion: 2.1 time: 0.203845 Oct 20 13:35:52.908631 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 13/29] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:52 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:52.919780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3c9fdd97-52c9-48e1-8b2c-f6dd4a5c0f97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:52.920844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3c9fdd97-52c9-48e1-8b2c-f6dd4a5c0f97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:53.030778 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3c9fdd97-52c9-48e1-8b2c-f6dd4a5c0f97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:53.038337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3c9fdd97-52c9-48e1-8b2c-f6dd4a5c0f97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1236 microversion: 2.1 time: 0.127395 Oct 20 13:35:53.042132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 14/30] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:52 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1236 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:53.313687 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Flavor limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:35:53.314224 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Image limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:35:53.314892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Flavor pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:35:53.315991 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Image pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:35:53.316799 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:35:53.373176 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:53.373798 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:53.375213 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:53.377792 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:53.380397 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:53.381358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:53.427162 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Getting quotas for project f9addc326c51410f809805d8b44c5c17. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:35:53.440643 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Getting quotas for user 55526ddbea014e6cbf7c079cb204059e and project f9addc326c51410f809805d8b44c5c17. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:35:53.464790 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Going to run 1 instances... {{(pid=125447) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:35:53.468042 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125447) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:35:53.593070 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-36a2dcd8-620d-44e4-a1d6-2f9aaf0fcaf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.974740 Oct 20 13:35:53.594133 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 17/31] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 20 13:35:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1977 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 20 13:35:53.607783 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ba1bdee7-832e-4cb6-9af4-927e6adac211 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:53.609686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ba1bdee7-832e-4cb6-9af4-927e6adac211 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:53.723866 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6d423846-4a8b-4c76-b3b1-ea6f12ed6a7a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:53.724747 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-6d423846-4a8b-4c76-b3b1-ea6f12ed6a7a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:53.735385 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6d423846-4a8b-4c76-b3b1-ea6f12ed6a7a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:53.743192 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6d423846-4a8b-4c76-b3b1-ea6f12ed6a7a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:53.743717 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6d423846-4a8b-4c76-b3b1-ea6f12ed6a7a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:53.745166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6d423846-4a8b-4c76-b3b1-ea6f12ed6a7a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:53.750200 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6d423846-4a8b-4c76-b3b1-ea6f12ed6a7a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:53.750755 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6d423846-4a8b-4c76-b3b1-ea6f12ed6a7a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:53.771151 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ba1bdee7-832e-4cb6-9af4-927e6adac211 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:53.801791 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ba1bdee7-832e-4cb6-9af4-927e6adac211 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:53.806129 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ba1bdee7-832e-4cb6-9af4-927e6adac211 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:53.813193 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ba1bdee7-832e-4cb6-9af4-927e6adac211 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1281 microversion: 2.20 time: 0.204647 Oct 20 13:35:53.814177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 15/32] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:35:53 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:35:53.936064 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a62d9663-c715-43cd-a3a6-6639cf1138a3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:53.937059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a62d9663-c715-43cd-a3a6-6639cf1138a3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:53.948706 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a62d9663-c715-43cd-a3a6-6639cf1138a3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:53.949407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a62d9663-c715-43cd-a3a6-6639cf1138a3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:53.949960 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a62d9663-c715-43cd-a3a6-6639cf1138a3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:53.950678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a62d9663-c715-43cd-a3a6-6639cf1138a3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:53.951125 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a62d9663-c715-43cd-a3a6-6639cf1138a3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:53.971197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a62d9663-c715-43cd-a3a6-6639cf1138a3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:54.235963 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-6d423846-4a8b-4c76-b3b1-ea6f12ed6a7a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:54.272644 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-6d423846-4a8b-4c76-b3b1-ea6f12ed6a7a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1238 microversion: 2.1 time: 0.552404 Oct 20 13:35:54.282303 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a62d9663-c715-43cd-a3a6-6639cf1138a3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:54.298410 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a62d9663-c715-43cd-a3a6-6639cf1138a3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1211 microversion: 2.1 time: 0.366623 Oct 20 13:35:54.314198 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 16/33] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:53 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1211 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:35:54.315413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 18/34] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:53 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1238 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:35:54.331516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e8023984-401b-4fa2-93d5-32dbbf6d901c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:54.332136 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e8023984-401b-4fa2-93d5-32dbbf6d901c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:54.361609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8023984-401b-4fa2-93d5-32dbbf6d901c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:54.362854 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8023984-401b-4fa2-93d5-32dbbf6d901c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:54.363384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8023984-401b-4fa2-93d5-32dbbf6d901c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:54.364710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8023984-401b-4fa2-93d5-32dbbf6d901c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:54.365235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8023984-401b-4fa2-93d5-32dbbf6d901c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:54.365678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8023984-401b-4fa2-93d5-32dbbf6d901c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:54.507804 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e8023984-401b-4fa2-93d5-32dbbf6d901c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:54.517296 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e8023984-401b-4fa2-93d5-32dbbf6d901c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1288 microversion: 2.1 time: 0.201706 Oct 20 13:35:54.522633 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 17/35] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:54 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1288 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:54.843177 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:54.843791 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:54.850751 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:54.851237 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:54.851963 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:54.852908 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:54.853563 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:54.854182 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:54.921766 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:54.932888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:54.935133 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:54.936251 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d4d6a159-5b7a-4d84-aef1-505441a6567b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1285 microversion: 2.20 time: 0.096937 Oct 20 13:35:54.936816 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 19/36] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:35:54 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:35:55.327036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-96ae4e1a-3e38-4483-87e6-4495bf189331 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:55.327881 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-96ae4e1a-3e38-4483-87e6-4495bf189331 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:55.332034 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-29038fb4-47e0-47cc-b8c4-0ec3f67b1646 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:55.332813 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-29038fb4-47e0-47cc-b8c4-0ec3f67b1646 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:55.335282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ae4e1a-3e38-4483-87e6-4495bf189331 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:55.335923 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ae4e1a-3e38-4483-87e6-4495bf189331 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:55.336519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ae4e1a-3e38-4483-87e6-4495bf189331 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:55.337403 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ae4e1a-3e38-4483-87e6-4495bf189331 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:55.337989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ae4e1a-3e38-4483-87e6-4495bf189331 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:55.338548 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ae4e1a-3e38-4483-87e6-4495bf189331 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:55.344589 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29038fb4-47e0-47cc-b8c4-0ec3f67b1646 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:55.346564 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29038fb4-47e0-47cc-b8c4-0ec3f67b1646 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:55.349397 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29038fb4-47e0-47cc-b8c4-0ec3f67b1646 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:55.351231 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29038fb4-47e0-47cc-b8c4-0ec3f67b1646 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:55.352313 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29038fb4-47e0-47cc-b8c4-0ec3f67b1646 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:55.353087 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29038fb4-47e0-47cc-b8c4-0ec3f67b1646 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:55.409768 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-96ae4e1a-3e38-4483-87e6-4495bf189331 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:55.417987 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-96ae4e1a-3e38-4483-87e6-4495bf189331 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1211 microversion: 2.1 time: 0.094753 Oct 20 13:35:55.434302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 18/37] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:55 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:55.456931 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-29038fb4-47e0-47cc-b8c4-0ec3f67b1646 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:55.467330 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-29038fb4-47e0-47cc-b8c4-0ec3f67b1646 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1238 microversion: 2.1 time: 0.141118 Oct 20 13:35:55.470526 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 20/38] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:55 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1238 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:55.554107 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-37365249-501a-41c2-833f-62940352f793 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:55.554815 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-37365249-501a-41c2-833f-62940352f793 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:55.561358 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37365249-501a-41c2-833f-62940352f793 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:55.561847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37365249-501a-41c2-833f-62940352f793 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:55.562344 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37365249-501a-41c2-833f-62940352f793 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:55.563033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37365249-501a-41c2-833f-62940352f793 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:55.563702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37365249-501a-41c2-833f-62940352f793 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:55.564152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37365249-501a-41c2-833f-62940352f793 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:55.636987 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-37365249-501a-41c2-833f-62940352f793 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:55.646771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-37365249-501a-41c2-833f-62940352f793 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1288 microversion: 2.1 time: 0.097217 Oct 20 13:35:55.647809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 19/39] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:55 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:55.962533 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:55.963477 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:55.969922 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:55.970636 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:55.971290 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:55.972738 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:55.973901 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:55.974492 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:56.061014 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:56.072893 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:56.074403 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:56.075696 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-951e7ca9-4a68-4f95-bbac-7f28c38c31a7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1285 microversion: 2.20 time: 0.117841 Oct 20 13:35:56.076253 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:35:55 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:35:56.441249 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d514177e-082e-47a6-831a-26f6a3c1c386 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:56.442566 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d514177e-082e-47a6-831a-26f6a3c1c386 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:56.449152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d514177e-082e-47a6-831a-26f6a3c1c386 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:56.449641 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d514177e-082e-47a6-831a-26f6a3c1c386 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:56.450289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d514177e-082e-47a6-831a-26f6a3c1c386 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:56.451183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d514177e-082e-47a6-831a-26f6a3c1c386 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:56.451638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d514177e-082e-47a6-831a-26f6a3c1c386 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:56.452055 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d514177e-082e-47a6-831a-26f6a3c1c386 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:56.493801 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-adf8626f-43b8-4463-8a9d-e409c87fb5e6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:56.494424 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-adf8626f-43b8-4463-8a9d-e409c87fb5e6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:56.501091 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adf8626f-43b8-4463-8a9d-e409c87fb5e6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:56.502097 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adf8626f-43b8-4463-8a9d-e409c87fb5e6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:56.504384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adf8626f-43b8-4463-8a9d-e409c87fb5e6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:56.505888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adf8626f-43b8-4463-8a9d-e409c87fb5e6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:56.506544 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adf8626f-43b8-4463-8a9d-e409c87fb5e6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:56.507159 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adf8626f-43b8-4463-8a9d-e409c87fb5e6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:56.528595 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d514177e-082e-47a6-831a-26f6a3c1c386 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:56.536777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d514177e-082e-47a6-831a-26f6a3c1c386 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1211 microversion: 2.1 time: 0.098866 Oct 20 13:35:56.537385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 20/41] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:56 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:56.571469 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-adf8626f-43b8-4463-8a9d-e409c87fb5e6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:56.579038 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-adf8626f-43b8-4463-8a9d-e409c87fb5e6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1238 microversion: 2.1 time: 0.089233 Oct 20 13:35:56.579604 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 22/42] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:56 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:35:56.670402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7cdd0c2c-7459-42d9-9028-322dcdced10f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:56.671016 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7cdd0c2c-7459-42d9-9028-322dcdced10f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:56.678041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cdd0c2c-7459-42d9-9028-322dcdced10f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:56.678526 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cdd0c2c-7459-42d9-9028-322dcdced10f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:56.678961 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cdd0c2c-7459-42d9-9028-322dcdced10f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:56.679651 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cdd0c2c-7459-42d9-9028-322dcdced10f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:56.680104 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cdd0c2c-7459-42d9-9028-322dcdced10f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:56.680527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cdd0c2c-7459-42d9-9028-322dcdced10f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:56.741386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7cdd0c2c-7459-42d9-9028-322dcdced10f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:56.748925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7cdd0c2c-7459-42d9-9028-322dcdced10f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1288 microversion: 2.1 time: 0.082305 Oct 20 13:35:56.749430 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 21/43] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:56 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:57.101794 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:57.102434 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:57.108435 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:57.108955 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:57.109412 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:57.110104 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:57.110566 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:57.111054 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:57.172277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:57.181002 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:57.182641 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:57.183743 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e2cf6a13-f1dd-468c-b554-07e32e1ea704 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1285 microversion: 2.20 time: 0.086210 Oct 20 13:35:57.184307 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:35:57 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:35:57.560550 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3b753650-70e6-46fb-a327-6b75ead8e7da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:57.561308 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3b753650-70e6-46fb-a327-6b75ead8e7da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:57.572643 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b753650-70e6-46fb-a327-6b75ead8e7da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:57.573284 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b753650-70e6-46fb-a327-6b75ead8e7da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:57.573594 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b753650-70e6-46fb-a327-6b75ead8e7da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:57.574861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b753650-70e6-46fb-a327-6b75ead8e7da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:57.574861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b753650-70e6-46fb-a327-6b75ead8e7da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:57.575268 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b753650-70e6-46fb-a327-6b75ead8e7da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:57.611159 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7af6ccbc-66e9-48f8-a63a-3804cc44967f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:57.611790 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7af6ccbc-66e9-48f8-a63a-3804cc44967f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:57.622087 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7af6ccbc-66e9-48f8-a63a-3804cc44967f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:57.624048 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7af6ccbc-66e9-48f8-a63a-3804cc44967f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:57.624506 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7af6ccbc-66e9-48f8-a63a-3804cc44967f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:57.629155 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7af6ccbc-66e9-48f8-a63a-3804cc44967f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:57.631823 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7af6ccbc-66e9-48f8-a63a-3804cc44967f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:57.634380 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7af6ccbc-66e9-48f8-a63a-3804cc44967f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:57.727812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3b753650-70e6-46fb-a327-6b75ead8e7da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:57.744596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3b753650-70e6-46fb-a327-6b75ead8e7da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1211 microversion: 2.1 time: 0.188381 Oct 20 13:35:57.745569 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 22/45] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:57 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1211 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:57.778135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ea0353ec-5a7b-49f5-a38f-64bbe9bebe2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:57.778827 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ea0353ec-5a7b-49f5-a38f-64bbe9bebe2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:57.786111 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ea0353ec-5a7b-49f5-a38f-64bbe9bebe2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:57.786918 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ea0353ec-5a7b-49f5-a38f-64bbe9bebe2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:57.788333 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ea0353ec-5a7b-49f5-a38f-64bbe9bebe2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:57.789372 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ea0353ec-5a7b-49f5-a38f-64bbe9bebe2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:57.789982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ea0353ec-5a7b-49f5-a38f-64bbe9bebe2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:57.790558 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ea0353ec-5a7b-49f5-a38f-64bbe9bebe2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:57.812208 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7af6ccbc-66e9-48f8-a63a-3804cc44967f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:57.837566 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7af6ccbc-66e9-48f8-a63a-3804cc44967f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1294 microversion: 2.1 time: 0.234773 Oct 20 13:35:57.843787 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 24/46] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:57 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1294 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:57.876967 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ea0353ec-5a7b-49f5-a38f-64bbe9bebe2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:57.891454 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ea0353ec-5a7b-49f5-a38f-64bbe9bebe2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1296 microversion: 2.1 time: 0.121979 Oct 20 13:35:57.892427 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 23/47] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:57 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1296 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:58.213543 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:58.214387 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:58.246535 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:58.247574 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:58.248031 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:58.249274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:58.251281 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:58.251911 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:58.438381 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:58.467186 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:58.472654 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:58.478925 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b1161d26-f7e3-4edf-b6cf-64b3e19489c4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1277 microversion: 2.20 time: 0.272374 Oct 20 13:35:58.479532 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 25/48] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:35:58 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1277 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:35:58.767717 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-edc4613e-dde6-4b50-9797-b4c4e551ee1c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:58.769180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-edc4613e-dde6-4b50-9797-b4c4e551ee1c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:58.804613 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-edc4613e-dde6-4b50-9797-b4c4e551ee1c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:58.808537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-edc4613e-dde6-4b50-9797-b4c4e551ee1c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:58.810197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-edc4613e-dde6-4b50-9797-b4c4e551ee1c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:58.815955 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-edc4613e-dde6-4b50-9797-b4c4e551ee1c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:58.819375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-edc4613e-dde6-4b50-9797-b4c4e551ee1c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:58.821534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-edc4613e-dde6-4b50-9797-b4c4e551ee1c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:58.862897 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0444dfab-dcdb-4145-9b2d-03af5cb4387c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:58.867039 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0444dfab-dcdb-4145-9b2d-03af5cb4387c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:58.885665 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0444dfab-dcdb-4145-9b2d-03af5cb4387c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:58.886227 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0444dfab-dcdb-4145-9b2d-03af5cb4387c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:58.886674 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0444dfab-dcdb-4145-9b2d-03af5cb4387c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:58.888559 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0444dfab-dcdb-4145-9b2d-03af5cb4387c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:58.889088 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0444dfab-dcdb-4145-9b2d-03af5cb4387c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:58.893111 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0444dfab-dcdb-4145-9b2d-03af5cb4387c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:59.185972 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-edc4613e-dde6-4b50-9797-b4c4e551ee1c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:59.188299 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0444dfab-dcdb-4145-9b2d-03af5cb4387c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:59.201725 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0444dfab-dcdb-4145-9b2d-03af5cb4387c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1312 microversion: 2.1 time: 0.341647 Oct 20 13:35:59.202307 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 26/49] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:58 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1312 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:59.228841 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7fcd19d4-b53a-4ef9-8c93-b5e32551b3b7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:59.229694 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-edc4613e-dde6-4b50-9797-b4c4e551ee1c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1267 microversion: 2.1 time: 0.465928 Oct 20 13:35:59.230769 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7fcd19d4-b53a-4ef9-8c93-b5e32551b3b7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:59.231829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 24/50] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:58 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1267 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:35:59.258795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7fcd19d4-b53a-4ef9-8c93-b5e32551b3b7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:59.261811 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7fcd19d4-b53a-4ef9-8c93-b5e32551b3b7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:59.262604 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7fcd19d4-b53a-4ef9-8c93-b5e32551b3b7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:59.264363 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7fcd19d4-b53a-4ef9-8c93-b5e32551b3b7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:59.265091 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7fcd19d4-b53a-4ef9-8c93-b5e32551b3b7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:59.265751 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7fcd19d4-b53a-4ef9-8c93-b5e32551b3b7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:59.510523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:35:59.511394 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:35:59.520791 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:59.533045 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:59.533739 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:59.534655 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:35:59.535297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:35:59.537058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:35:59.805667 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:59.823905 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:59.829203 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:35:59.833251 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-00421382-15be-4ef7-b793-e6fd24ff1341 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1333 microversion: 2.20 time: 0.326500 Oct 20 13:35:59.837681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:35:59 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1333 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:00.046818 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7fcd19d4-b53a-4ef9-8c93-b5e32551b3b7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:00.055978 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7fcd19d4-b53a-4ef9-8c93-b5e32551b3b7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.836382 Oct 20 13:36:00.056563 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 27/52] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:35:59 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:00.225336 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ad821eb0-480b-4bd3-a20c-ab34b91b1922 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:00.226343 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ad821eb0-480b-4bd3-a20c-ab34b91b1922 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:00.253519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad821eb0-480b-4bd3-a20c-ab34b91b1922 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:00.259470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad821eb0-480b-4bd3-a20c-ab34b91b1922 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:00.261279 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad821eb0-480b-4bd3-a20c-ab34b91b1922 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:00.262328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad821eb0-480b-4bd3-a20c-ab34b91b1922 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:00.271819 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c7a18353-a077-4723-97f6-571f01851332 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:00.272756 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-c7a18353-a077-4723-97f6-571f01851332 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:00.276920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad821eb0-480b-4bd3-a20c-ab34b91b1922 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:00.280373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad821eb0-480b-4bd3-a20c-ab34b91b1922 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:00.295329 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7a18353-a077-4723-97f6-571f01851332 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:00.304180 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7a18353-a077-4723-97f6-571f01851332 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:00.305067 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7a18353-a077-4723-97f6-571f01851332 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:00.306396 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7a18353-a077-4723-97f6-571f01851332 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:00.310340 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7a18353-a077-4723-97f6-571f01851332 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:00.321098 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7a18353-a077-4723-97f6-571f01851332 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:00.796810 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ad821eb0-480b-4bd3-a20c-ab34b91b1922 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:00.826270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ad821eb0-480b-4bd3-a20c-ab34b91b1922 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1300 microversion: 2.1 time: 0.602691 Oct 20 13:36:00.833304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 26/53] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:00 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1300 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:00.869948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:00.871889 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:00.891823 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:00.893443 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:00.894196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:00.895505 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:00.897829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:00.899682 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:01.195874 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:01.213686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:01.217908 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:01.222952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-72886956-15cc-4a27-bdc1-2819d106097f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1351 microversion: 2.20 time: 0.360110 Oct 20 13:36:01.225921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 27/54] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:00 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1351 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:01.236748 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7af9097f-267e-4d80-9122-d928b19c0def tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:01.239974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7af9097f-267e-4d80-9122-d928b19c0def tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:01.255862 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7af9097f-267e-4d80-9122-d928b19c0def tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:01.259233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7af9097f-267e-4d80-9122-d928b19c0def tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:01.261176 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7af9097f-267e-4d80-9122-d928b19c0def tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:01.262324 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7af9097f-267e-4d80-9122-d928b19c0def tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:01.262838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7af9097f-267e-4d80-9122-d928b19c0def tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:01.263267 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7af9097f-267e-4d80-9122-d928b19c0def tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:01.406495 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c7a18353-a077-4723-97f6-571f01851332 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:01.415066 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-c7a18353-a077-4723-97f6-571f01851332 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1273 microversion: 2.1 time: 1.148285 Oct 20 13:36:01.415846 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 28/55] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:00 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1273 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:01.863353 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7a8d040a-ccf4-407d-bfe1-ad6183daa277 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:01.866414 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7a8d040a-ccf4-407d-bfe1-ad6183daa277 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:01.883307 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7a8d040a-ccf4-407d-bfe1-ad6183daa277 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:01.884060 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7a8d040a-ccf4-407d-bfe1-ad6183daa277 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:01.885371 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7a8d040a-ccf4-407d-bfe1-ad6183daa277 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:01.886609 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7a8d040a-ccf4-407d-bfe1-ad6183daa277 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:01.888507 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7a8d040a-ccf4-407d-bfe1-ad6183daa277 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:01.889315 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7a8d040a-ccf4-407d-bfe1-ad6183daa277 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:02.126369 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=4 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:02.143752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7af9097f-267e-4d80-9122-d928b19c0def tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:02.158750 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7af9097f-267e-4d80-9122-d928b19c0def tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.930702 Oct 20 13:36:02.168960 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 28/56] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:01 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:02.261664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:02.262501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:02.288433 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:02.289016 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:02.289419 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:02.290105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:02.290561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:02.290991 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:02.613622 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7a8d040a-ccf4-407d-bfe1-ad6183daa277 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:02.629105 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7a8d040a-ccf4-407d-bfe1-ad6183daa277 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.769691 Oct 20 13:36:02.630747 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 29/57] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:01 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:02.683649 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-ff934d93-7028-4d5f-ba10-3adac21f2921 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:02.686272 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-ff934d93-7028-4d5f-ba10-3adac21f2921 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:02.739421 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff934d93-7028-4d5f-ba10-3adac21f2921 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:02.740789 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff934d93-7028-4d5f-ba10-3adac21f2921 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:02.742232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff934d93-7028-4d5f-ba10-3adac21f2921 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:02.743798 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff934d93-7028-4d5f-ba10-3adac21f2921 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:02.745163 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff934d93-7028-4d5f-ba10-3adac21f2921 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:02.746502 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff934d93-7028-4d5f-ba10-3adac21f2921 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:02.916950 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:02.928368 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-ff934d93-7028-4d5f-ba10-3adac21f2921 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:02.931122 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:02.934489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:02.937524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e8287850-b072-49cd-b129-6aad4eb0df06 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1339 microversion: 2.20 time: 0.684049 Oct 20 13:36:02.938140 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-ff934d93-7028-4d5f-ba10-3adac21f2921 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1273 microversion: 2.1 time: 0.288304 Oct 20 13:36:02.952905 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 30/58] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:02 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1273 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:02.961212 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 29/59] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:02 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1339 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:03.187332 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c1d4d885-8c2e-46b6-b9e0-6efa74d73f2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:03.188072 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-c1d4d885-8c2e-46b6-b9e0-6efa74d73f2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:03.198702 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c1d4d885-8c2e-46b6-b9e0-6efa74d73f2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:03.199195 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c1d4d885-8c2e-46b6-b9e0-6efa74d73f2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:03.199623 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c1d4d885-8c2e-46b6-b9e0-6efa74d73f2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:03.201716 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c1d4d885-8c2e-46b6-b9e0-6efa74d73f2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:03.202247 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c1d4d885-8c2e-46b6-b9e0-6efa74d73f2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:03.213865 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c1d4d885-8c2e-46b6-b9e0-6efa74d73f2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:03.405330 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=4 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:03.457207 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=24 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:03.654113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f83799bf-1be7-4018-aff4-53403ca4d2bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:03.655442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f83799bf-1be7-4018-aff4-53403ca4d2bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:03.667465 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f83799bf-1be7-4018-aff4-53403ca4d2bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:03.670420 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f83799bf-1be7-4018-aff4-53403ca4d2bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:03.672068 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f83799bf-1be7-4018-aff4-53403ca4d2bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:03.673215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f83799bf-1be7-4018-aff4-53403ca4d2bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:03.673814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f83799bf-1be7-4018-aff4-53403ca4d2bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:03.675137 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f83799bf-1be7-4018-aff4-53403ca4d2bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:03.807177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=24 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:03.807422 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c1d4d885-8c2e-46b6-b9e0-6efa74d73f2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:03.816449 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-c1d4d885-8c2e-46b6-b9e0-6efa74d73f2e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.633220 Oct 20 13:36:03.817537 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 31/60] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:03 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:03.968180 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3eb6a017-bd9f-4eec-bdb0-7bde714244d2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:03.969128 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3eb6a017-bd9f-4eec-bdb0-7bde714244d2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:03.981757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3eb6a017-bd9f-4eec-bdb0-7bde714244d2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:03.982522 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3eb6a017-bd9f-4eec-bdb0-7bde714244d2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:03.984812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3eb6a017-bd9f-4eec-bdb0-7bde714244d2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:03.985826 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3eb6a017-bd9f-4eec-bdb0-7bde714244d2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:03.987349 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3eb6a017-bd9f-4eec-bdb0-7bde714244d2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:03.987998 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3eb6a017-bd9f-4eec-bdb0-7bde714244d2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:04.298967 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f83799bf-1be7-4018-aff4-53403ca4d2bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:04.306799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f83799bf-1be7-4018-aff4-53403ca4d2bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.656543 Oct 20 13:36:04.307381 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 30/61] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:03 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:04.316333 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:04.327414 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:04.337466 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:04.339987 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:04.340605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:04.341503 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:04.342290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:04.342942 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:04.701392 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3eb6a017-bd9f-4eec-bdb0-7bde714244d2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:04.713715 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3eb6a017-bd9f-4eec-bdb0-7bde714244d2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.749702 Oct 20 13:36:04.717637 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 32/62] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:03 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:04.846220 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7003fa2c-8e5a-482b-aae3-1b7f69f6620b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:04.846924 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7003fa2c-8e5a-482b-aae3-1b7f69f6620b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:04.851031 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:04.865701 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7003fa2c-8e5a-482b-aae3-1b7f69f6620b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:04.866608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7003fa2c-8e5a-482b-aae3-1b7f69f6620b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:04.867451 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7003fa2c-8e5a-482b-aae3-1b7f69f6620b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:04.870026 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7003fa2c-8e5a-482b-aae3-1b7f69f6620b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:04.871671 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7003fa2c-8e5a-482b-aae3-1b7f69f6620b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:04.873229 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7003fa2c-8e5a-482b-aae3-1b7f69f6620b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:05.681857 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:05.690220 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=100 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:05.698879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:05.700847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:05.702396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7a4361ce-3277-4351-af38-2a0b734118df tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 1.394098 Oct 20 13:36:05.703466 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 31/63] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:04 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:05.714584 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-db5cc272-75ca-41ed-8e19-084c22993bb0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:05.715558 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-db5cc272-75ca-41ed-8e19-084c22993bb0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:05.721545 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:05.736749 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db5cc272-75ca-41ed-8e19-084c22993bb0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:05.737452 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db5cc272-75ca-41ed-8e19-084c22993bb0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:05.738873 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db5cc272-75ca-41ed-8e19-084c22993bb0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:05.739814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db5cc272-75ca-41ed-8e19-084c22993bb0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:05.752894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db5cc272-75ca-41ed-8e19-084c22993bb0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:05.755094 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db5cc272-75ca-41ed-8e19-084c22993bb0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:06.407320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7003fa2c-8e5a-482b-aae3-1b7f69f6620b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:06.416665 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=100 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:06.448520 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7003fa2c-8e5a-482b-aae3-1b7f69f6620b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 1.604842 Oct 20 13:36:06.451266 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 33/64] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:04 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:06.470904 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3591c13c-2a57-45c5-b919-ac2a272e5751 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:06.471851 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3591c13c-2a57-45c5-b919-ac2a272e5751 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:06.483865 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-db5cc272-75ca-41ed-8e19-084c22993bb0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:06.493013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3591c13c-2a57-45c5-b919-ac2a272e5751 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:06.494292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3591c13c-2a57-45c5-b919-ac2a272e5751 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:06.495579 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3591c13c-2a57-45c5-b919-ac2a272e5751 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:06.496365 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3591c13c-2a57-45c5-b919-ac2a272e5751 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:06.496837 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3591c13c-2a57-45c5-b919-ac2a272e5751 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:06.499837 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3591c13c-2a57-45c5-b919-ac2a272e5751 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:06.514768 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-db5cc272-75ca-41ed-8e19-084c22993bb0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.800397 Oct 20 13:36:06.516721 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 32/65] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:05 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:06.885021 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-ca2157b9-5dc9-41c5-b3b2-ac1960e4c7a6 req-bc65b510-851e-44f5-b557-a006b5c12608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19146772-f7e2-43d8-b7b3-3c365f024e54", "tag": "20c71ca9-62f4-4658-828a-7e49ec9d9631"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:06.912629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ca2157b9-5dc9-41c5-b3b2-ac1960e4c7a6 req-bc65b510-851e-44f5-b557-a006b5c12608 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:06.914116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ca2157b9-5dc9-41c5-b3b2-ac1960e4c7a6 req-bc65b510-851e-44f5-b557-a006b5c12608 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:06.915519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ca2157b9-5dc9-41c5-b3b2-ac1960e4c7a6 req-bc65b510-851e-44f5-b557-a006b5c12608 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:06.952886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-ca2157b9-5dc9-41c5-b3b2-ac1960e4c7a6 req-bc65b510-851e-44f5-b557-a006b5c12608 service nova] Creating event network-changed:20c71ca9-62f4-4658-828a-7e49ec9d9631 for instance 19146772-f7e2-43d8-b7b3-3c365f024e54 on hv-cinder-86213 Oct 20 13:36:06.954066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ca2157b9-5dc9-41c5-b3b2-ac1960e4c7a6 req-bc65b510-851e-44f5-b557-a006b5c12608 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125448) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 20 13:36:06.954835 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ca2157b9-5dc9-41c5-b3b2-ac1960e4c7a6 req-bc65b510-851e-44f5-b557-a006b5c12608 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125448) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 20 13:36:06.957862 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27e916b5-21a8-4b92-a728-e80ce9ecc540 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:06.959431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27e916b5-21a8-4b92-a728-e80ce9ecc540 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:06.960711 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27e916b5-21a8-4b92-a728-e80ce9ecc540 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:06.962654 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27e916b5-21a8-4b92-a728-e80ce9ecc540 None None] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:06.963944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27e916b5-21a8-4b92-a728-e80ce9ecc540 None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:06.965246 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27e916b5-21a8-4b92-a728-e80ce9ecc540 None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:06.982344 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.compute.rpcapi [None req-27e916b5-21a8-4b92-a728-e80ce9ecc540 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 20 13:36:06.984264 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27e916b5-21a8-4b92-a728-e80ce9ecc540 None None] Releasing lock "compute-rpcapi-router" {{(pid=125448) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 20 13:36:07.007975 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-27e916b5-21a8-4b92-a728-e80ce9ecc540 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.486913 Oct 20 13:36:07.008578 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 33/66] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:36:07.015541 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:07.016293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:07.024069 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:07.024808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:07.025401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:07.026325 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:07.026914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:07.027474 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:07.168592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3591c13c-2a57-45c5-b919-ac2a272e5751 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:07.183678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3591c13c-2a57-45c5-b919-ac2a272e5751 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.730843 Oct 20 13:36:07.184803 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 34/67] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:06 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:07.470780 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-825f5640-eba5-4af8-b780-dc8d2fa3d678 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:07.471522 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-825f5640-eba5-4af8-b780-dc8d2fa3d678 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:07.480683 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-825f5640-eba5-4af8-b780-dc8d2fa3d678 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:07.481601 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-825f5640-eba5-4af8-b780-dc8d2fa3d678 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:07.481747 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-825f5640-eba5-4af8-b780-dc8d2fa3d678 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:07.482333 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-825f5640-eba5-4af8-b780-dc8d2fa3d678 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:07.482785 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-825f5640-eba5-4af8-b780-dc8d2fa3d678 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:07.483211 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-825f5640-eba5-4af8-b780-dc8d2fa3d678 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:08.033195 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-825f5640-eba5-4af8-b780-dc8d2fa3d678 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:08.042787 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-825f5640-eba5-4af8-b780-dc8d2fa3d678 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.575926 Oct 20 13:36:08.053971 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 35/68] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:07 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:08.070829 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e4bd8ecf-0d75-43d1-bc2f-c489ccb81bf1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:08.071678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e4bd8ecf-0d75-43d1-bc2f-c489ccb81bf1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:08.081468 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e4bd8ecf-0d75-43d1-bc2f-c489ccb81bf1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:08.082778 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e4bd8ecf-0d75-43d1-bc2f-c489ccb81bf1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:08.087147 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e4bd8ecf-0d75-43d1-bc2f-c489ccb81bf1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:08.088173 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e4bd8ecf-0d75-43d1-bc2f-c489ccb81bf1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:08.088805 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e4bd8ecf-0d75-43d1-bc2f-c489ccb81bf1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:08.089269 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e4bd8ecf-0d75-43d1-bc2f-c489ccb81bf1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:08.190970 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:08.211115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:08.212948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:08.214959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ec3ef4eb-6249-4014-b128-ed3f797dd317 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 1.203521 Oct 20 13:36:08.216147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 34/69] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:07 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:08.614154 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-e63ff751-b0d9-4b86-ad54-31f24a82aad8 req-556f4429-e326-454d-81a0-702165ea3209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417ecff7-87f2-4818-9e78-a698e13fe46d", "tag": "aa084c37-d6d3-49cd-83ce-62d9de1a28b8"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:08.634490 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-e63ff751-b0d9-4b86-ad54-31f24a82aad8 req-556f4429-e326-454d-81a0-702165ea3209 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:08.636598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-e63ff751-b0d9-4b86-ad54-31f24a82aad8 req-556f4429-e326-454d-81a0-702165ea3209 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:08.637692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-e63ff751-b0d9-4b86-ad54-31f24a82aad8 req-556f4429-e326-454d-81a0-702165ea3209 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:08.662577 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-e63ff751-b0d9-4b86-ad54-31f24a82aad8 req-556f4429-e326-454d-81a0-702165ea3209 service nova] Creating event network-changed:aa084c37-d6d3-49cd-83ce-62d9de1a28b8 for instance 417ecff7-87f2-4818-9e78-a698e13fe46d on hv-cinder-86213 Oct 20 13:36:08.676452 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-e63ff751-b0d9-4b86-ad54-31f24a82aad8 req-556f4429-e326-454d-81a0-702165ea3209 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.452674 Oct 20 13:36:08.677372 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 35/70] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:36:08.693155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7f490515-18a1-406d-9da3-2f6ec7c739b8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:08.694042 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7f490515-18a1-406d-9da3-2f6ec7c739b8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:08.711438 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f490515-18a1-406d-9da3-2f6ec7c739b8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:08.713468 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f490515-18a1-406d-9da3-2f6ec7c739b8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:08.714162 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f490515-18a1-406d-9da3-2f6ec7c739b8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:08.715620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f490515-18a1-406d-9da3-2f6ec7c739b8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:08.717385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f490515-18a1-406d-9da3-2f6ec7c739b8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:08.718615 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f490515-18a1-406d-9da3-2f6ec7c739b8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:08.799191 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e4bd8ecf-0d75-43d1-bc2f-c489ccb81bf1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:08.808238 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e4bd8ecf-0d75-43d1-bc2f-c489ccb81bf1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.752966 Oct 20 13:36:08.809306 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 36/71] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:08 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:09.000367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7f490515-18a1-406d-9da3-2f6ec7c739b8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:09.010784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7f490515-18a1-406d-9da3-2f6ec7c739b8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.331097 Oct 20 13:36:09.012768 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 36/72] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:08 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:09.023431 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-d24a31db-212a-4d80-a864-078cc07f8cc3 req-a006c503-83ec-4d7d-973c-d0c5b390d6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07ca6e8-83ee-4690-97c1-7cc13774d5ea", "tag": "945c0530-b30a-4e15-a586-dfaaa2fdd6ae"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:09.037592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-d24a31db-212a-4d80-a864-078cc07f8cc3 req-a006c503-83ec-4d7d-973c-d0c5b390d6a3 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:09.038367 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-d24a31db-212a-4d80-a864-078cc07f8cc3 req-a006c503-83ec-4d7d-973c-d0c5b390d6a3 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:09.038996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-d24a31db-212a-4d80-a864-078cc07f8cc3 req-a006c503-83ec-4d7d-973c-d0c5b390d6a3 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:09.062717 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-d24a31db-212a-4d80-a864-078cc07f8cc3 req-a006c503-83ec-4d7d-973c-d0c5b390d6a3 service nova] Creating event network-changed:945c0530-b30a-4e15-a586-dfaaa2fdd6ae for instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea on hv-cinder-86213 Oct 20 13:36:09.063340 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-d24a31db-212a-4d80-a864-078cc07f8cc3 req-a006c503-83ec-4d7d-973c-d0c5b390d6a3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125447) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 20 13:36:09.063806 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-d24a31db-212a-4d80-a864-078cc07f8cc3 req-a006c503-83ec-4d7d-973c-d0c5b390d6a3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125447) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 20 13:36:09.064944 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2aa7b891-731a-4a6a-a3ba-222639662896 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:09.065474 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2aa7b891-731a-4a6a-a3ba-222639662896 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:09.065992 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2aa7b891-731a-4a6a-a3ba-222639662896 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:09.066860 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2aa7b891-731a-4a6a-a3ba-222639662896 None None] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:09.067399 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2aa7b891-731a-4a6a-a3ba-222639662896 None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:09.067958 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2aa7b891-731a-4a6a-a3ba-222639662896 None None] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:09.077502 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.compute.rpcapi [None req-2aa7b891-731a-4a6a-a3ba-222639662896 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 20 13:36:09.078604 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2aa7b891-731a-4a6a-a3ba-222639662896 None None] Releasing lock "compute-rpcapi-router" {{(pid=125447) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 20 13:36:09.079914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9014b6ec-7073-4870-9e03-7a1162c98150 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:09.080530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9014b6ec-7073-4870-9e03-7a1162c98150 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:09.090827 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9014b6ec-7073-4870-9e03-7a1162c98150 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:09.091320 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9014b6ec-7073-4870-9e03-7a1162c98150 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:09.091750 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9014b6ec-7073-4870-9e03-7a1162c98150 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:09.092436 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9014b6ec-7073-4870-9e03-7a1162c98150 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:09.093037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9014b6ec-7073-4870-9e03-7a1162c98150 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:09.093532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9014b6ec-7073-4870-9e03-7a1162c98150 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:09.099632 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-2aa7b891-731a-4a6a-a3ba-222639662896 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078320 Oct 20 13:36:09.100565 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 37/73] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:36:09.246291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:09.246991 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:09.253662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:09.254648 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:09.255079 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:09.255935 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:09.256531 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:09.257134 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:09.316111 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9014b6ec-7073-4870-9e03-7a1162c98150 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:09.335768 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9014b6ec-7073-4870-9e03-7a1162c98150 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.259508 Oct 20 13:36:09.336764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 37/74] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:09 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:09.422632 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:09.437452 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:09.439821 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:09.441767 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-14f0cb61-1fbb-4ac7-a141-8d69d784c6ec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.200446 Oct 20 13:36:09.442772 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 38/75] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:09 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:36:09.833231 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-35708b54-6ea7-4294-96ff-1cd8b5018531 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:09.834132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-35708b54-6ea7-4294-96ff-1cd8b5018531 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:09.840720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35708b54-6ea7-4294-96ff-1cd8b5018531 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:09.841376 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35708b54-6ea7-4294-96ff-1cd8b5018531 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:09.841891 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35708b54-6ea7-4294-96ff-1cd8b5018531 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:09.842674 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35708b54-6ea7-4294-96ff-1cd8b5018531 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:09.843276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35708b54-6ea7-4294-96ff-1cd8b5018531 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:09.843841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35708b54-6ea7-4294-96ff-1cd8b5018531 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:10.016017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-35708b54-6ea7-4294-96ff-1cd8b5018531 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:10.025873 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-35708b54-6ea7-4294-96ff-1cd8b5018531 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.197591 Oct 20 13:36:10.026927 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 38/76] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:09 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:10.034928 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5f9528dd-dd70-4767-8270-df07087cc5fd tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:10.036575 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5f9528dd-dd70-4767-8270-df07087cc5fd tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:10.045157 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f9528dd-dd70-4767-8270-df07087cc5fd tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:10.045481 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f9528dd-dd70-4767-8270-df07087cc5fd tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:10.045919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f9528dd-dd70-4767-8270-df07087cc5fd tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:10.046614 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f9528dd-dd70-4767-8270-df07087cc5fd tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:10.047063 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f9528dd-dd70-4767-8270-df07087cc5fd tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:10.049064 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f9528dd-dd70-4767-8270-df07087cc5fd tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:10.248035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5f9528dd-dd70-4767-8270-df07087cc5fd tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:10.264898 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5f9528dd-dd70-4767-8270-df07087cc5fd tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.233178 Oct 20 13:36:10.280780 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 39/77] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:10 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:10.364211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-97d19993-21d9-4a52-aca6-d8956ad9810d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:10.364847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-97d19993-21d9-4a52-aca6-d8956ad9810d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:10.371692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-97d19993-21d9-4a52-aca6-d8956ad9810d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:10.372237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-97d19993-21d9-4a52-aca6-d8956ad9810d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:10.372759 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-97d19993-21d9-4a52-aca6-d8956ad9810d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:10.373512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-97d19993-21d9-4a52-aca6-d8956ad9810d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:10.373964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-97d19993-21d9-4a52-aca6-d8956ad9810d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:10.374387 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-97d19993-21d9-4a52-aca6-d8956ad9810d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:10.470331 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:10.470936 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:10.479211 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:10.479787 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:10.480223 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:10.480926 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:10.481822 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:10.483091 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:10.537300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-97d19993-21d9-4a52-aca6-d8956ad9810d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:10.551401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-97d19993-21d9-4a52-aca6-d8956ad9810d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.193573 Oct 20 13:36:10.551988 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 39/78] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:10 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:10.669602 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:10.690288 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:10.704568 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-f936afac-1830-4e17-890c-805da73b405b req-21a7a96a-5336-4fe1-b5bd-a930cf38ac80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b9ae5b-1e55-409f-9a61-b1e2a47d1b58", "tag": "c4329cd6-ac99-4465-b271-c87f6eb593c4"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:10.707365 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:10.710350 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d11a4bb0-04d3-44d5-8539-621ea9c9fe61 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.246618 Oct 20 13:36:10.730512 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 40/79] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:10 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:36:10.736802 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f936afac-1830-4e17-890c-805da73b405b req-21a7a96a-5336-4fe1-b5bd-a930cf38ac80 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:10.737323 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f936afac-1830-4e17-890c-805da73b405b req-21a7a96a-5336-4fe1-b5bd-a930cf38ac80 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:10.737747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f936afac-1830-4e17-890c-805da73b405b req-21a7a96a-5336-4fe1-b5bd-a930cf38ac80 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:10.756110 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-f936afac-1830-4e17-890c-805da73b405b req-21a7a96a-5336-4fe1-b5bd-a930cf38ac80 service nova] Creating event network-changed:c4329cd6-ac99-4465-b271-c87f6eb593c4 for instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 on hv-cinder-86213 Oct 20 13:36:10.768831 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-f936afac-1830-4e17-890c-805da73b405b req-21a7a96a-5336-4fe1-b5bd-a930cf38ac80 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067977 Oct 20 13:36:10.771385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 40/80] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:36:11.050966 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9d440703-62a5-46ea-b488-a71b2115b595 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:11.051584 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9d440703-62a5-46ea-b488-a71b2115b595 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:11.058003 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d440703-62a5-46ea-b488-a71b2115b595 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:11.058560 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d440703-62a5-46ea-b488-a71b2115b595 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:11.059279 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d440703-62a5-46ea-b488-a71b2115b595 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:11.060264 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d440703-62a5-46ea-b488-a71b2115b595 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:11.061058 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d440703-62a5-46ea-b488-a71b2115b595 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:11.061662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d440703-62a5-46ea-b488-a71b2115b595 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:11.236454 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9d440703-62a5-46ea-b488-a71b2115b595 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:11.246693 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9d440703-62a5-46ea-b488-a71b2115b595 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.199249 Oct 20 13:36:11.247327 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 41/81] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:11 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:11.292380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fdcb7b97-df0d-4bf8-9283-e484807d2f46 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:11.293115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fdcb7b97-df0d-4bf8-9283-e484807d2f46 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:11.299364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fdcb7b97-df0d-4bf8-9283-e484807d2f46 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:11.299840 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fdcb7b97-df0d-4bf8-9283-e484807d2f46 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:11.300427 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fdcb7b97-df0d-4bf8-9283-e484807d2f46 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:11.301703 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fdcb7b97-df0d-4bf8-9283-e484807d2f46 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:11.302192 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fdcb7b97-df0d-4bf8-9283-e484807d2f46 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:11.302614 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fdcb7b97-df0d-4bf8-9283-e484807d2f46 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:11.459576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fdcb7b97-df0d-4bf8-9283-e484807d2f46 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:11.472084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fdcb7b97-df0d-4bf8-9283-e484807d2f46 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.184501 Oct 20 13:36:11.485480 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 41/82] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:11 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:11.577287 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c652fcb0-74fd-413c-954d-7a5318c82219 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:11.577904 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-c652fcb0-74fd-413c-954d-7a5318c82219 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:11.587191 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c652fcb0-74fd-413c-954d-7a5318c82219 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:11.588069 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c652fcb0-74fd-413c-954d-7a5318c82219 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:11.588657 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c652fcb0-74fd-413c-954d-7a5318c82219 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:11.589391 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c652fcb0-74fd-413c-954d-7a5318c82219 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:11.589853 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c652fcb0-74fd-413c-954d-7a5318c82219 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:11.590255 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c652fcb0-74fd-413c-954d-7a5318c82219 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:11.742441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:11.744416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:11.757274 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:11.761098 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:11.761712 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:11.764177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:11.764639 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:11.768690 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:11.823099 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c652fcb0-74fd-413c-954d-7a5318c82219 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:11.833966 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-c652fcb0-74fd-413c-954d-7a5318c82219 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.260925 Oct 20 13:36:11.834885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 42/83] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:11 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:12.016992 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:12.026546 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:12.028551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:12.030533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-45971e99-5acb-459e-b86c-49e3782cbbf8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.291397 Oct 20 13:36:12.053479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 42/84] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:11 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:12.272035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a8167a28-b814-48ab-b15e-a11b4694818f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:12.272649 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a8167a28-b814-48ab-b15e-a11b4694818f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:12.286594 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a8167a28-b814-48ab-b15e-a11b4694818f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:12.288996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a8167a28-b814-48ab-b15e-a11b4694818f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:12.289609 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a8167a28-b814-48ab-b15e-a11b4694818f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:12.293650 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a8167a28-b814-48ab-b15e-a11b4694818f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:12.295064 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a8167a28-b814-48ab-b15e-a11b4694818f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:12.295889 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a8167a28-b814-48ab-b15e-a11b4694818f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:12.498036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-bf3c78f7-f8dc-46d2-8afb-b94404236edb tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:12.499494 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-bf3c78f7-f8dc-46d2-8afb-b94404236edb tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:12.508661 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bf3c78f7-f8dc-46d2-8afb-b94404236edb tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:12.509630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bf3c78f7-f8dc-46d2-8afb-b94404236edb tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:12.511406 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bf3c78f7-f8dc-46d2-8afb-b94404236edb tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:12.512367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bf3c78f7-f8dc-46d2-8afb-b94404236edb tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:12.513779 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bf3c78f7-f8dc-46d2-8afb-b94404236edb tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:12.514436 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bf3c78f7-f8dc-46d2-8afb-b94404236edb tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:12.523404 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a8167a28-b814-48ab-b15e-a11b4694818f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:12.537638 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a8167a28-b814-48ab-b15e-a11b4694818f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.271035 Oct 20 13:36:12.538527 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 43/85] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:12 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:12.784922 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-bf3c78f7-f8dc-46d2-8afb-b94404236edb tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:12.794453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-bf3c78f7-f8dc-46d2-8afb-b94404236edb tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.300552 Oct 20 13:36:12.795045 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 43/86] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:12 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:12.860208 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9353cdaa-c3a3-465f-8b1d-78ad3156fbbd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:12.861743 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9353cdaa-c3a3-465f-8b1d-78ad3156fbbd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:12.869846 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9353cdaa-c3a3-465f-8b1d-78ad3156fbbd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:12.870401 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9353cdaa-c3a3-465f-8b1d-78ad3156fbbd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:12.870759 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9353cdaa-c3a3-465f-8b1d-78ad3156fbbd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:12.871459 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9353cdaa-c3a3-465f-8b1d-78ad3156fbbd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:12.871909 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9353cdaa-c3a3-465f-8b1d-78ad3156fbbd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:12.872329 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9353cdaa-c3a3-465f-8b1d-78ad3156fbbd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:13.029053 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9353cdaa-c3a3-465f-8b1d-78ad3156fbbd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:13.036759 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9353cdaa-c3a3-465f-8b1d-78ad3156fbbd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.183465 Oct 20 13:36:13.037359 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 44/87] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:12 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:13.063534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:13.064139 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:13.070932 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:13.071426 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:13.071886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:13.072575 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:13.073083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:13.073536 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:13.215903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:13.224197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:13.225692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:13.226790 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fef1eee5-c3c8-4a9a-a462-582ca1575d22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.167172 Oct 20 13:36:13.227352 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 44/88] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:13 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:13.559959 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-42626a8c-9878-468d-8280-00e7b23b41c1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:13.560569 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-42626a8c-9878-468d-8280-00e7b23b41c1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:13.567668 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-42626a8c-9878-468d-8280-00e7b23b41c1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:13.568152 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-42626a8c-9878-468d-8280-00e7b23b41c1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:13.568581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-42626a8c-9878-468d-8280-00e7b23b41c1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:13.569297 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-42626a8c-9878-468d-8280-00e7b23b41c1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:13.569748 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-42626a8c-9878-468d-8280-00e7b23b41c1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:13.570168 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-42626a8c-9878-468d-8280-00e7b23b41c1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:13.694864 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-42626a8c-9878-468d-8280-00e7b23b41c1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:13.702902 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-42626a8c-9878-468d-8280-00e7b23b41c1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.146327 Oct 20 13:36:13.702997 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 45/89] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:13 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:13.817748 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cd6857f5-9f0a-44ef-bf09-e1dbf47f5136 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:13.818356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cd6857f5-9f0a-44ef-bf09-e1dbf47f5136 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:13.824323 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd6857f5-9f0a-44ef-bf09-e1dbf47f5136 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:13.824803 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd6857f5-9f0a-44ef-bf09-e1dbf47f5136 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:13.825266 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd6857f5-9f0a-44ef-bf09-e1dbf47f5136 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:13.825946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd6857f5-9f0a-44ef-bf09-e1dbf47f5136 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:13.826392 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd6857f5-9f0a-44ef-bf09-e1dbf47f5136 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:13.826807 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd6857f5-9f0a-44ef-bf09-e1dbf47f5136 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:13.951794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd6857f5-9f0a-44ef-bf09-e1dbf47f5136 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:13.960387 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cd6857f5-9f0a-44ef-bf09-e1dbf47f5136 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.146701 Oct 20 13:36:13.960981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 45/90] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:13 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:14.061172 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d09cbed2-c6c8-4e04-9cb5-6a8be0916b6c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:14.061773 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d09cbed2-c6c8-4e04-9cb5-6a8be0916b6c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:14.068610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d09cbed2-c6c8-4e04-9cb5-6a8be0916b6c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:14.069115 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d09cbed2-c6c8-4e04-9cb5-6a8be0916b6c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:14.069547 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d09cbed2-c6c8-4e04-9cb5-6a8be0916b6c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:14.070218 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d09cbed2-c6c8-4e04-9cb5-6a8be0916b6c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:14.070661 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d09cbed2-c6c8-4e04-9cb5-6a8be0916b6c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:14.071103 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d09cbed2-c6c8-4e04-9cb5-6a8be0916b6c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:14.200734 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d09cbed2-c6c8-4e04-9cb5-6a8be0916b6c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:14.208402 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d09cbed2-c6c8-4e04-9cb5-6a8be0916b6c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.151013 Oct 20 13:36:14.208974 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 46/91] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:14 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:14.251415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:14.252015 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:14.258288 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:14.258766 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:14.259189 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:14.259859 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:14.260305 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:14.260717 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:14.387753 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:14.396580 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:14.398070 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:14.399178 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8fdbe18f-0c04-41af-a396-3f9e857a3422 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.151636 Oct 20 13:36:14.399749 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 46/92] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:14 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:14.725044 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-eadaeb39-08dd-4c7d-b7e2-85eda5ac04ec tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:14.725680 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-eadaeb39-08dd-4c7d-b7e2-85eda5ac04ec tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:14.731620 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-eadaeb39-08dd-4c7d-b7e2-85eda5ac04ec tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:14.732382 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-eadaeb39-08dd-4c7d-b7e2-85eda5ac04ec tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:14.732821 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-eadaeb39-08dd-4c7d-b7e2-85eda5ac04ec tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:14.734074 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-eadaeb39-08dd-4c7d-b7e2-85eda5ac04ec tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:14.734534 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-eadaeb39-08dd-4c7d-b7e2-85eda5ac04ec tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:14.734958 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-eadaeb39-08dd-4c7d-b7e2-85eda5ac04ec tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:14.965249 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-eadaeb39-08dd-4c7d-b7e2-85eda5ac04ec tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:14.972971 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-eadaeb39-08dd-4c7d-b7e2-85eda5ac04ec tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.251788 Oct 20 13:36:14.973533 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 47/93] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:14 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:14.983066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-717eed7f-dba5-4135-9814-7ebfcb684fac tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:14.984300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-717eed7f-dba5-4135-9814-7ebfcb684fac tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:14.990218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-717eed7f-dba5-4135-9814-7ebfcb684fac tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:14.990691 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-717eed7f-dba5-4135-9814-7ebfcb684fac tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:14.991112 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-717eed7f-dba5-4135-9814-7ebfcb684fac tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:14.991810 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-717eed7f-dba5-4135-9814-7ebfcb684fac tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:14.992251 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-717eed7f-dba5-4135-9814-7ebfcb684fac tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:14.992664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-717eed7f-dba5-4135-9814-7ebfcb684fac tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:15.126039 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-717eed7f-dba5-4135-9814-7ebfcb684fac tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:15.134557 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-717eed7f-dba5-4135-9814-7ebfcb684fac tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.155535 Oct 20 13:36:15.135128 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 47/94] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:14 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:15.230553 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-557dac23-f8ad-44f6-8fd3-f75b846d56dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:15.231156 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-557dac23-f8ad-44f6-8fd3-f75b846d56dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:15.236946 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-557dac23-f8ad-44f6-8fd3-f75b846d56dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:15.237608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-557dac23-f8ad-44f6-8fd3-f75b846d56dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:15.238197 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-557dac23-f8ad-44f6-8fd3-f75b846d56dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:15.238914 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-557dac23-f8ad-44f6-8fd3-f75b846d56dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:15.239364 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-557dac23-f8ad-44f6-8fd3-f75b846d56dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:15.239781 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-557dac23-f8ad-44f6-8fd3-f75b846d56dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:15.425029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:15.425749 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:15.431873 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:15.432398 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:15.432853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:15.433578 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:15.434034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:15.434460 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:15.545780 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-557dac23-f8ad-44f6-8fd3-f75b846d56dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:15.554450 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-557dac23-f8ad-44f6-8fd3-f75b846d56dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.327673 Oct 20 13:36:15.555118 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 48/95] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:15 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:15.597974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:15.606400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:15.607870 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:15.609187 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e04543fb-24f6-44de-bdc9-afaaa2c64364 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.188125 Oct 20 13:36:15.609859 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 48/96] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:15 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:36:15.997430 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-54691602-1293-4358-ad8c-a4b25aeea5bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:15.997851 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-54691602-1293-4358-ad8c-a4b25aeea5bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:16.004576 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-54691602-1293-4358-ad8c-a4b25aeea5bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:16.005347 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-54691602-1293-4358-ad8c-a4b25aeea5bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:16.005906 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-54691602-1293-4358-ad8c-a4b25aeea5bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:16.006661 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-54691602-1293-4358-ad8c-a4b25aeea5bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:16.007174 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-54691602-1293-4358-ad8c-a4b25aeea5bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:16.007669 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-54691602-1293-4358-ad8c-a4b25aeea5bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:16.160958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2cd1b711-2004-4956-9bd4-0fc81cde3d83 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:16.161553 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2cd1b711-2004-4956-9bd4-0fc81cde3d83 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:16.163591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-54691602-1293-4358-ad8c-a4b25aeea5bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:16.168674 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cd1b711-2004-4956-9bd4-0fc81cde3d83 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:16.169653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cd1b711-2004-4956-9bd4-0fc81cde3d83 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:16.170379 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cd1b711-2004-4956-9bd4-0fc81cde3d83 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:16.172759 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-54691602-1293-4358-ad8c-a4b25aeea5bd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.180034 Oct 20 13:36:16.173049 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cd1b711-2004-4956-9bd4-0fc81cde3d83 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:16.173499 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 49/97] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:15 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:16.173824 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cd1b711-2004-4956-9bd4-0fc81cde3d83 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:16.174396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cd1b711-2004-4956-9bd4-0fc81cde3d83 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:16.329201 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2cd1b711-2004-4956-9bd4-0fc81cde3d83 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:16.338139 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2cd1b711-2004-4956-9bd4-0fc81cde3d83 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.182805 Oct 20 13:36:16.341814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 49/98] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:16 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:16.583064 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d8c126aa-7ab6-4ee1-81f3-4fc536b7e589 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:16.583984 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d8c126aa-7ab6-4ee1-81f3-4fc536b7e589 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:16.590423 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8c126aa-7ab6-4ee1-81f3-4fc536b7e589 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:16.590912 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8c126aa-7ab6-4ee1-81f3-4fc536b7e589 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:16.591347 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8c126aa-7ab6-4ee1-81f3-4fc536b7e589 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:16.592051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8c126aa-7ab6-4ee1-81f3-4fc536b7e589 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:16.592540 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8c126aa-7ab6-4ee1-81f3-4fc536b7e589 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:16.592989 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8c126aa-7ab6-4ee1-81f3-4fc536b7e589 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:16.635014 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:16.635637 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:16.642059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:16.642541 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:16.642970 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:16.643668 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:16.644637 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:16.645108 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:16.649999 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=100 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:16.749394 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d8c126aa-7ab6-4ee1-81f3-4fc536b7e589 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:16.753384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=100 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:16.758724 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d8c126aa-7ab6-4ee1-81f3-4fc536b7e589 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.180649 Oct 20 13:36:16.759397 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 50/99] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:16 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:16.802770 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:16.811041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:16.812496 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:16.813636 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-92e15741-2224-4e1a-b28d-8613a9f3846a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.182695 Oct 20 13:36:16.814204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 50/100] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:16 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:36:17.196063 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e87ed392-d49d-4cd2-b4e3-6de416347ab2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:17.196666 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e87ed392-d49d-4cd2-b4e3-6de416347ab2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:17.202740 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e87ed392-d49d-4cd2-b4e3-6de416347ab2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:17.203210 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e87ed392-d49d-4cd2-b4e3-6de416347ab2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:17.203631 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e87ed392-d49d-4cd2-b4e3-6de416347ab2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:17.204303 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e87ed392-d49d-4cd2-b4e3-6de416347ab2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:17.204745 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e87ed392-d49d-4cd2-b4e3-6de416347ab2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:17.205183 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e87ed392-d49d-4cd2-b4e3-6de416347ab2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:17.335314 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e87ed392-d49d-4cd2-b4e3-6de416347ab2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:17.343424 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e87ed392-d49d-4cd2-b4e3-6de416347ab2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.151175 Oct 20 13:36:17.343980 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 51/101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:17 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:17.363374 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3cd49976-77c9-4f58-91cf-e9a89872f316 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:17.363975 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3cd49976-77c9-4f58-91cf-e9a89872f316 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:17.365797 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:17.371037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cd49976-77c9-4f58-91cf-e9a89872f316 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:17.371521 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cd49976-77c9-4f58-91cf-e9a89872f316 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:17.371941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cd49976-77c9-4f58-91cf-e9a89872f316 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:17.372615 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cd49976-77c9-4f58-91cf-e9a89872f316 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:17.373091 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cd49976-77c9-4f58-91cf-e9a89872f316 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:17.373507 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cd49976-77c9-4f58-91cf-e9a89872f316 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:17.504085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3cd49976-77c9-4f58-91cf-e9a89872f316 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:17.512074 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3cd49976-77c9-4f58-91cf-e9a89872f316 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.152512 Oct 20 13:36:17.512637 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 51/102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:17 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:17.782016 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-50998eb5-4c66-46db-9ac7-32b8d21fc68c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:17.782617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-50998eb5-4c66-46db-9ac7-32b8d21fc68c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:17.788987 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50998eb5-4c66-46db-9ac7-32b8d21fc68c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:17.789465 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50998eb5-4c66-46db-9ac7-32b8d21fc68c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:17.789911 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50998eb5-4c66-46db-9ac7-32b8d21fc68c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:17.790568 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50998eb5-4c66-46db-9ac7-32b8d21fc68c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:17.791014 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50998eb5-4c66-46db-9ac7-32b8d21fc68c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:17.791426 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50998eb5-4c66-46db-9ac7-32b8d21fc68c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:17.839432 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:17.845250 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:17.852480 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:17.853000 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:17.853431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:17.854186 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:17.854773 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:17.855095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:17.942300 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-50998eb5-4c66-46db-9ac7-32b8d21fc68c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:17.954871 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-50998eb5-4c66-46db-9ac7-32b8d21fc68c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.176479 Oct 20 13:36:17.957543 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 52/103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:17 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:18.026734 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:18.042946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:18.044380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:18.045860 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ca3dc4c9-5141-4e99-ac34-00b9ae89b1af tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.210847 Oct 20 13:36:18.046493 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 52/104] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:17 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:18.371419 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9143a869-de6b-4898-8ae0-e0ee65e2f30b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:18.372015 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9143a869-de6b-4898-8ae0-e0ee65e2f30b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:18.380641 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9143a869-de6b-4898-8ae0-e0ee65e2f30b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:18.381146 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9143a869-de6b-4898-8ae0-e0ee65e2f30b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:18.381578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9143a869-de6b-4898-8ae0-e0ee65e2f30b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:18.382260 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9143a869-de6b-4898-8ae0-e0ee65e2f30b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:18.382706 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9143a869-de6b-4898-8ae0-e0ee65e2f30b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:18.383119 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9143a869-de6b-4898-8ae0-e0ee65e2f30b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:18.517424 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9143a869-de6b-4898-8ae0-e0ee65e2f30b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:18.525137 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9143a869-de6b-4898-8ae0-e0ee65e2f30b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.161420 Oct 20 13:36:18.525701 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 53/105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:18 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:18.536193 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a5403182-39d4-4331-9484-5736bc38fc8f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:18.536939 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a5403182-39d4-4331-9484-5736bc38fc8f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:18.542917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5403182-39d4-4331-9484-5736bc38fc8f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:18.543388 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5403182-39d4-4331-9484-5736bc38fc8f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:18.543807 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5403182-39d4-4331-9484-5736bc38fc8f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:18.544599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5403182-39d4-4331-9484-5736bc38fc8f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:18.545019 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5403182-39d4-4331-9484-5736bc38fc8f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:18.545440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5403182-39d4-4331-9484-5736bc38fc8f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:18.669375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a5403182-39d4-4331-9484-5736bc38fc8f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:18.677075 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a5403182-39d4-4331-9484-5736bc38fc8f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.145342 Oct 20 13:36:18.677645 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 53/106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:18 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:18.982821 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b7e08f5a-10c7-4fac-bb2f-cd3b121f9bfc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:18.983431 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b7e08f5a-10c7-4fac-bb2f-cd3b121f9bfc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:18.990163 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b7e08f5a-10c7-4fac-bb2f-cd3b121f9bfc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:18.990647 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b7e08f5a-10c7-4fac-bb2f-cd3b121f9bfc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:18.991078 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b7e08f5a-10c7-4fac-bb2f-cd3b121f9bfc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:18.991785 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b7e08f5a-10c7-4fac-bb2f-cd3b121f9bfc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:18.992237 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b7e08f5a-10c7-4fac-bb2f-cd3b121f9bfc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:18.992663 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b7e08f5a-10c7-4fac-bb2f-cd3b121f9bfc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:19.077959 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=2 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:19.084989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:19.085800 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:19.091742 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:19.092226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:19.092893 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:19.093575 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:19.094311 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:19.094765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:19.131048 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b7e08f5a-10c7-4fac-bb2f-cd3b121f9bfc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:19.139366 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b7e08f5a-10c7-4fac-bb2f-cd3b121f9bfc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.160231 Oct 20 13:36:19.139937 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 54/107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:18 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:19.236220 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:19.245532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:19.247011 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:19.248144 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-51862241-3467-4d1c-bcbe-0d44ad48d660 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.167159 Oct 20 13:36:19.248757 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 54/108] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:19 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:19.548396 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5b93c090-7bf5-40db-a869-5fc7726d0912 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:19.549046 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5b93c090-7bf5-40db-a869-5fc7726d0912 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:19.555535 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b93c090-7bf5-40db-a869-5fc7726d0912 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:19.556014 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b93c090-7bf5-40db-a869-5fc7726d0912 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:19.556447 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b93c090-7bf5-40db-a869-5fc7726d0912 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:19.557152 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b93c090-7bf5-40db-a869-5fc7726d0912 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:19.557604 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b93c090-7bf5-40db-a869-5fc7726d0912 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:19.558024 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b93c090-7bf5-40db-a869-5fc7726d0912 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:19.686156 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5b93c090-7bf5-40db-a869-5fc7726d0912 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:19.693953 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5b93c090-7bf5-40db-a869-5fc7726d0912 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.149410 Oct 20 13:36:19.694790 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 55/109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:19 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:19.699596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f21ea3dd-66c9-41b7-9617-c97847d3356a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:19.700200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f21ea3dd-66c9-41b7-9617-c97847d3356a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:19.706083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f21ea3dd-66c9-41b7-9617-c97847d3356a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:19.707111 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f21ea3dd-66c9-41b7-9617-c97847d3356a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:19.707669 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f21ea3dd-66c9-41b7-9617-c97847d3356a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:19.708338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f21ea3dd-66c9-41b7-9617-c97847d3356a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:19.708777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f21ea3dd-66c9-41b7-9617-c97847d3356a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:19.709238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f21ea3dd-66c9-41b7-9617-c97847d3356a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:19.836598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f21ea3dd-66c9-41b7-9617-c97847d3356a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:19.844276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f21ea3dd-66c9-41b7-9617-c97847d3356a tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.148540 Oct 20 13:36:19.844835 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 55/110] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:19 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:20.165461 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e71858b1-6eaa-47da-b634-59edf5ecfd49 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:20.166073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e71858b1-6eaa-47da-b634-59edf5ecfd49 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:20.171893 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e71858b1-6eaa-47da-b634-59edf5ecfd49 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:20.172370 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e71858b1-6eaa-47da-b634-59edf5ecfd49 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:20.172799 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e71858b1-6eaa-47da-b634-59edf5ecfd49 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:20.173498 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e71858b1-6eaa-47da-b634-59edf5ecfd49 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:20.173947 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e71858b1-6eaa-47da-b634-59edf5ecfd49 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:20.174363 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e71858b1-6eaa-47da-b634-59edf5ecfd49 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:20.273795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:20.274594 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:20.280370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:20.281065 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:20.281490 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:20.282158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:20.282614 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:20.283041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:20.310913 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e71858b1-6eaa-47da-b634-59edf5ecfd49 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:20.319678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e71858b1-6eaa-47da-b634-59edf5ecfd49 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.158017 Oct 20 13:36:20.320245 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 56/111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:20 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:20.412771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:20.420682 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:20.422161 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:20.423245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3c77a889-851b-480c-9ed3-a9b8cf61edb2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.153238 Oct 20 13:36:20.423799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 56/112] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:20 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:36:20.717436 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-cd694288-7e71-49b7-bf0b-be238964e3a2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:20.717958 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-cd694288-7e71-49b7-bf0b-be238964e3a2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:20.724325 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cd694288-7e71-49b7-bf0b-be238964e3a2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:20.724798 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cd694288-7e71-49b7-bf0b-be238964e3a2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:20.725246 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cd694288-7e71-49b7-bf0b-be238964e3a2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:20.725919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cd694288-7e71-49b7-bf0b-be238964e3a2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:20.726358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cd694288-7e71-49b7-bf0b-be238964e3a2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:20.726769 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cd694288-7e71-49b7-bf0b-be238964e3a2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:20.855836 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-cd694288-7e71-49b7-bf0b-be238964e3a2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:20.863482 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-cd694288-7e71-49b7-bf0b-be238964e3a2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.150295 Oct 20 13:36:20.864034 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 57/113] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:20 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:20.867540 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-854f09db-d1aa-485d-baea-43588e3058e3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:20.868173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-854f09db-d1aa-485d-baea-43588e3058e3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:20.874095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-854f09db-d1aa-485d-baea-43588e3058e3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:20.874568 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-854f09db-d1aa-485d-baea-43588e3058e3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:20.874995 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-854f09db-d1aa-485d-baea-43588e3058e3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:20.875671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-854f09db-d1aa-485d-baea-43588e3058e3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:20.876115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-854f09db-d1aa-485d-baea-43588e3058e3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:20.876529 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-854f09db-d1aa-485d-baea-43588e3058e3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:21.001373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-854f09db-d1aa-485d-baea-43588e3058e3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:21.010057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-854f09db-d1aa-485d-baea-43588e3058e3 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.146395 Oct 20 13:36:21.010609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 57/114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:20 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:21.342183 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c230672c-a477-4d3d-94aa-f27dd8382b17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:21.342784 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-c230672c-a477-4d3d-94aa-f27dd8382b17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:21.348831 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c230672c-a477-4d3d-94aa-f27dd8382b17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:21.349333 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c230672c-a477-4d3d-94aa-f27dd8382b17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:21.349758 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c230672c-a477-4d3d-94aa-f27dd8382b17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:21.350433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c230672c-a477-4d3d-94aa-f27dd8382b17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:21.350875 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c230672c-a477-4d3d-94aa-f27dd8382b17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:21.351296 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c230672c-a477-4d3d-94aa-f27dd8382b17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:21.449406 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:21.450041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:21.456608 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:21.457111 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:21.457573 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:21.458251 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:21.458692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:21.459101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:21.483446 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c230672c-a477-4d3d-94aa-f27dd8382b17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:21.493378 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-c230672c-a477-4d3d-94aa-f27dd8382b17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.154893 Oct 20 13:36:21.494458 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 58/115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:21 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:21.608548 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:21.616945 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:21.618389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:21.619474 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f5ca5efc-962d-4890-8730-77285b43163f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.175441 Oct 20 13:36:21.620027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 58/116] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:21 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:36:21.886689 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-68fc3d58-b6b2-4ea1-ab78-254ef89480bc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:21.887288 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-68fc3d58-b6b2-4ea1-ab78-254ef89480bc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:21.893212 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68fc3d58-b6b2-4ea1-ab78-254ef89480bc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:21.893684 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68fc3d58-b6b2-4ea1-ab78-254ef89480bc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:21.894322 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68fc3d58-b6b2-4ea1-ab78-254ef89480bc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:21.894990 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68fc3d58-b6b2-4ea1-ab78-254ef89480bc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:21.895431 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68fc3d58-b6b2-4ea1-ab78-254ef89480bc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:21.895846 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68fc3d58-b6b2-4ea1-ab78-254ef89480bc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:22.021478 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-68fc3d58-b6b2-4ea1-ab78-254ef89480bc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:22.029073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-68fc3d58-b6b2-4ea1-ab78-254ef89480bc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.146144 Oct 20 13:36:22.029629 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 59/117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:21 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:22.033622 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e702f65a-1219-429e-a51e-980f711f126f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:22.034245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e702f65a-1219-429e-a51e-980f711f126f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:22.040295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e702f65a-1219-429e-a51e-980f711f126f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:22.040773 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e702f65a-1219-429e-a51e-980f711f126f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:22.041249 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e702f65a-1219-429e-a51e-980f711f126f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:22.041929 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e702f65a-1219-429e-a51e-980f711f126f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:22.042381 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e702f65a-1219-429e-a51e-980f711f126f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:22.042801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e702f65a-1219-429e-a51e-980f711f126f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:22.172622 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e702f65a-1219-429e-a51e-980f711f126f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:22.180816 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e702f65a-1219-429e-a51e-980f711f126f tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.151020 Oct 20 13:36:22.181405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 59/118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:22 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:22.517277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-080ac98a-7184-4722-b694-5ce8339a008f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:22.517877 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-080ac98a-7184-4722-b694-5ce8339a008f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:22.524522 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-080ac98a-7184-4722-b694-5ce8339a008f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:22.525050 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-080ac98a-7184-4722-b694-5ce8339a008f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:22.525475 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-080ac98a-7184-4722-b694-5ce8339a008f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:22.526149 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-080ac98a-7184-4722-b694-5ce8339a008f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:22.526589 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-080ac98a-7184-4722-b694-5ce8339a008f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:22.527026 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-080ac98a-7184-4722-b694-5ce8339a008f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:22.648077 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:22.649135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:22.659158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:22.662111 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:22.664487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:22.666130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:22.668653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:22.669278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:22.736995 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-080ac98a-7184-4722-b694-5ce8339a008f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:22.756251 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-080ac98a-7184-4722-b694-5ce8339a008f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.242338 Oct 20 13:36:22.757648 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 60/119] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:22 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:22.824222 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-75f34b97-8538-489d-ae4f-6817269b8941 req-8d8500e7-fb8f-4995-9825-5f245c30c674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19146772-f7e2-43d8-b7b3-3c365f024e54", "name": "network-vif-plugged", "status": "completed", "tag": "20c71ca9-62f4-4658-828a-7e49ec9d9631"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:22.834696 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-75f34b97-8538-489d-ae4f-6817269b8941 req-8d8500e7-fb8f-4995-9825-5f245c30c674 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:22.835180 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-75f34b97-8538-489d-ae4f-6817269b8941 req-8d8500e7-fb8f-4995-9825-5f245c30c674 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:22.835625 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-75f34b97-8538-489d-ae4f-6817269b8941 req-8d8500e7-fb8f-4995-9825-5f245c30c674 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:22.847457 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-75f34b97-8538-489d-ae4f-6817269b8941 req-8d8500e7-fb8f-4995-9825-5f245c30c674 service nova] Creating event network-vif-plugged:20c71ca9-62f4-4658-828a-7e49ec9d9631 for instance 19146772-f7e2-43d8-b7b3-3c365f024e54 on hv-cinder-86213 Oct 20 13:36:22.852961 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-75f34b97-8538-489d-ae4f-6817269b8941 req-8d8500e7-fb8f-4995-9825-5f245c30c674 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094011 Oct 20 13:36:22.853396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:22.853920 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 61/120] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:36:22.861680 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:22.863957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:22.865088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3285d72e-8284-43e0-85ef-9e4b7d6e03fc tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.222481 Oct 20 13:36:22.865646 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 60/121] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:22 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:36:23.052308 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b4876af0-e7a0-42c3-a35d-da22922643ee tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:23.053051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b4876af0-e7a0-42c3-a35d-da22922643ee tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:23.060063 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4876af0-e7a0-42c3-a35d-da22922643ee tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:23.060766 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4876af0-e7a0-42c3-a35d-da22922643ee tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:23.061360 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4876af0-e7a0-42c3-a35d-da22922643ee tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:23.062061 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4876af0-e7a0-42c3-a35d-da22922643ee tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:23.062514 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4876af0-e7a0-42c3-a35d-da22922643ee tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:23.062962 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4876af0-e7a0-42c3-a35d-da22922643ee tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:23.203397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cd456477-5a87-4ab2-a657-87b9311e8e74 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:23.204004 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cd456477-5a87-4ab2-a657-87b9311e8e74 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:23.210884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd456477-5a87-4ab2-a657-87b9311e8e74 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:23.211361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd456477-5a87-4ab2-a657-87b9311e8e74 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:23.212071 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd456477-5a87-4ab2-a657-87b9311e8e74 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:23.213103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd456477-5a87-4ab2-a657-87b9311e8e74 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:23.213694 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd456477-5a87-4ab2-a657-87b9311e8e74 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:23.214258 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd456477-5a87-4ab2-a657-87b9311e8e74 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:23.240049 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b4876af0-e7a0-42c3-a35d-da22922643ee tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:23.249563 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b4876af0-e7a0-42c3-a35d-da22922643ee tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.201652 Oct 20 13:36:23.250456 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 62/122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:23 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:23.509152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd456477-5a87-4ab2-a657-87b9311e8e74 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:23.517743 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cd456477-5a87-4ab2-a657-87b9311e8e74 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.318244 Oct 20 13:36:23.518319 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 61/123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:23 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:23.780913 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-df728982-10a0-4e39-9ed6-84c913fae3ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:23.781789 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-df728982-10a0-4e39-9ed6-84c913fae3ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:23.789241 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-df728982-10a0-4e39-9ed6-84c913fae3ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:23.789733 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-df728982-10a0-4e39-9ed6-84c913fae3ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:23.790193 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-df728982-10a0-4e39-9ed6-84c913fae3ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:23.790917 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-df728982-10a0-4e39-9ed6-84c913fae3ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:23.791458 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-df728982-10a0-4e39-9ed6-84c913fae3ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:23.792083 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-df728982-10a0-4e39-9ed6-84c913fae3ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:23.891871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:23.893066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:23.900293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:23.900782 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:23.901237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:23.902091 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:23.902681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:23.903265 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:23.939412 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-df728982-10a0-4e39-9ed6-84c913fae3ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:23.947536 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-df728982-10a0-4e39-9ed6-84c913fae3ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.170693 Oct 20 13:36:23.948103 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 63/124] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:23 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:24.090349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:24.098895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:24.100315 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:24.101417 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c77fed81-4e88-42e6-92d9-144d0b7f65b9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.214821 Oct 20 13:36:24.101964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 62/125] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:23 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:24.274211 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-13584e9b-0ad6-4ee7-9b41-a1c6adca98cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:24.274825 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-13584e9b-0ad6-4ee7-9b41-a1c6adca98cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:24.280659 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13584e9b-0ad6-4ee7-9b41-a1c6adca98cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:24.281166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13584e9b-0ad6-4ee7-9b41-a1c6adca98cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:24.281598 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13584e9b-0ad6-4ee7-9b41-a1c6adca98cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:24.282475 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13584e9b-0ad6-4ee7-9b41-a1c6adca98cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:24.283548 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13584e9b-0ad6-4ee7-9b41-a1c6adca98cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:24.283983 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13584e9b-0ad6-4ee7-9b41-a1c6adca98cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:24.437168 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-13584e9b-0ad6-4ee7-9b41-a1c6adca98cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:24.445869 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-13584e9b-0ad6-4ee7-9b41-a1c6adca98cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.175520 Oct 20 13:36:24.446434 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 64/126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:24 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:24.541479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-df3d00ba-d2c0-4623-b0a8-1ddb53952f8d tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:24.542090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-df3d00ba-d2c0-4623-b0a8-1ddb53952f8d tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:24.548042 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df3d00ba-d2c0-4623-b0a8-1ddb53952f8d tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:24.548528 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df3d00ba-d2c0-4623-b0a8-1ddb53952f8d tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:24.548990 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df3d00ba-d2c0-4623-b0a8-1ddb53952f8d tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:24.549671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df3d00ba-d2c0-4623-b0a8-1ddb53952f8d tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:24.550724 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df3d00ba-d2c0-4623-b0a8-1ddb53952f8d tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:24.551155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df3d00ba-d2c0-4623-b0a8-1ddb53952f8d tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:24.698731 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-df3d00ba-d2c0-4623-b0a8-1ddb53952f8d tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:24.706840 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-df3d00ba-d2c0-4623-b0a8-1ddb53952f8d tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.168807 Oct 20 13:36:24.707502 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 63/127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:24 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:24.970569 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-32388069-ac2b-4870-bd7c-0163822a594d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:24.971202 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-32388069-ac2b-4870-bd7c-0163822a594d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:24.977764 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32388069-ac2b-4870-bd7c-0163822a594d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:24.978243 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32388069-ac2b-4870-bd7c-0163822a594d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:24.978674 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32388069-ac2b-4870-bd7c-0163822a594d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:24.979348 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32388069-ac2b-4870-bd7c-0163822a594d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:24.979791 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32388069-ac2b-4870-bd7c-0163822a594d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:24.980203 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32388069-ac2b-4870-bd7c-0163822a594d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:25.127732 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:25.129211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:25.136150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:25.136947 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:25.137790 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:25.138834 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:25.139524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:25.140146 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:25.451617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-32388069-ac2b-4870-bd7c-0163822a594d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:25.462880 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-32388069-ac2b-4870-bd7c-0163822a594d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.495903 Oct 20 13:36:25.465032 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 65/128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:24 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:25.478648 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b54d8f00-b5dd-4c13-a45b-db5512198499 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:25.480722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b54d8f00-b5dd-4c13-a45b-db5512198499 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:25.494016 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b54d8f00-b5dd-4c13-a45b-db5512198499 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:25.494509 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b54d8f00-b5dd-4c13-a45b-db5512198499 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:25.494943 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b54d8f00-b5dd-4c13-a45b-db5512198499 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:25.495650 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b54d8f00-b5dd-4c13-a45b-db5512198499 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:25.496103 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b54d8f00-b5dd-4c13-a45b-db5512198499 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:25.496526 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b54d8f00-b5dd-4c13-a45b-db5512198499 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:25.521673 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:25.537781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:25.544449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:25.549068 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cf122556-6008-4152-a535-f78aefbff2d6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.424334 Oct 20 13:36:25.550775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 64/129] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:25 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:25.731008 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-affd32f5-29b6-47c8-bf22-c9f5962a6fb9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:25.731958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-affd32f5-29b6-47c8-bf22-c9f5962a6fb9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:25.741670 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-affd32f5-29b6-47c8-bf22-c9f5962a6fb9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:25.742180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-affd32f5-29b6-47c8-bf22-c9f5962a6fb9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:25.745471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-affd32f5-29b6-47c8-bf22-c9f5962a6fb9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:25.746468 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-affd32f5-29b6-47c8-bf22-c9f5962a6fb9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:25.747124 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-affd32f5-29b6-47c8-bf22-c9f5962a6fb9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:25.747730 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-affd32f5-29b6-47c8-bf22-c9f5962a6fb9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:25.799390 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b54d8f00-b5dd-4c13-a45b-db5512198499 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:25.809977 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b54d8f00-b5dd-4c13-a45b-db5512198499 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.343328 Oct 20 13:36:25.811569 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 66/130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:25 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:25.991148 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-affd32f5-29b6-47c8-bf22-c9f5962a6fb9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:26.001565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-affd32f5-29b6-47c8-bf22-c9f5962a6fb9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.275088 Oct 20 13:36:26.002358 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 65/131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:25 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:26.449526 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-ff9b094b-3c7d-46d4-94c6-794cc9525792 req-528d7ca6-0f20-4b7b-b75a-1eca23aec519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07ca6e8-83ee-4690-97c1-7cc13774d5ea", "name": "network-vif-plugged", "status": "completed", "tag": "945c0530-b30a-4e15-a586-dfaaa2fdd6ae"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:26.461682 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-ff9b094b-3c7d-46d4-94c6-794cc9525792 req-528d7ca6-0f20-4b7b-b75a-1eca23aec519 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:26.462266 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-ff9b094b-3c7d-46d4-94c6-794cc9525792 req-528d7ca6-0f20-4b7b-b75a-1eca23aec519 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:26.462763 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-ff9b094b-3c7d-46d4-94c6-794cc9525792 req-528d7ca6-0f20-4b7b-b75a-1eca23aec519 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:26.478245 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-ff9b094b-3c7d-46d4-94c6-794cc9525792 req-528d7ca6-0f20-4b7b-b75a-1eca23aec519 service nova] Creating event network-vif-plugged:945c0530-b30a-4e15-a586-dfaaa2fdd6ae for instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea on hv-cinder-86213 Oct 20 13:36:26.483734 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-ff9b094b-3c7d-46d4-94c6-794cc9525792 req-528d7ca6-0f20-4b7b-b75a-1eca23aec519 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037650 Oct 20 13:36:26.484835 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 67/132] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:36:26.493208 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c3a360cb-c855-472e-8d7d-fc8cf6418b86 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:26.493885 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c3a360cb-c855-472e-8d7d-fc8cf6418b86 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:26.507213 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3a360cb-c855-472e-8d7d-fc8cf6418b86 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:26.507905 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3a360cb-c855-472e-8d7d-fc8cf6418b86 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:26.508666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3a360cb-c855-472e-8d7d-fc8cf6418b86 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:26.509742 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3a360cb-c855-472e-8d7d-fc8cf6418b86 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:26.510640 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3a360cb-c855-472e-8d7d-fc8cf6418b86 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:26.511206 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3a360cb-c855-472e-8d7d-fc8cf6418b86 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:26.577095 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:26.578015 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:26.585768 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:26.586269 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:26.586893 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:26.587685 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:26.588181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:26.588606 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:26.685999 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c3a360cb-c855-472e-8d7d-fc8cf6418b86 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:26.690966 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=100 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:26.696950 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c3a360cb-c855-472e-8d7d-fc8cf6418b86 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.208372 Oct 20 13:36:26.698106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 66/133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:26 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:26.809637 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:26.813042 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=100 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:26.819098 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:26.820678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:26.821931 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d62f2a4f-a1ca-48ac-b9b3-ba7b8c2ede1b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.249685 Oct 20 13:36:26.822641 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 68/134] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:26 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:26.841034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-41010c6a-dc72-4dce-bba8-a7e28227e30f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:26.841034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-41010c6a-dc72-4dce-bba8-a7e28227e30f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:26.841699 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-41010c6a-dc72-4dce-bba8-a7e28227e30f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:26.842187 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-41010c6a-dc72-4dce-bba8-a7e28227e30f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:26.842617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-41010c6a-dc72-4dce-bba8-a7e28227e30f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:26.843307 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-41010c6a-dc72-4dce-bba8-a7e28227e30f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:26.843760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-41010c6a-dc72-4dce-bba8-a7e28227e30f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:26.844179 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-41010c6a-dc72-4dce-bba8-a7e28227e30f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:27.005851 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-41010c6a-dc72-4dce-bba8-a7e28227e30f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:27.015814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-41010c6a-dc72-4dce-bba8-a7e28227e30f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.184870 Oct 20 13:36:27.016691 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 67/135] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:26 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:27.025051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-ecf75647-95b2-437e-9410-2a2b97bc54a0 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:27.025644 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-ecf75647-95b2-437e-9410-2a2b97bc54a0 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:27.034814 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ecf75647-95b2-437e-9410-2a2b97bc54a0 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:27.036138 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ecf75647-95b2-437e-9410-2a2b97bc54a0 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:27.036587 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ecf75647-95b2-437e-9410-2a2b97bc54a0 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:27.037338 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ecf75647-95b2-437e-9410-2a2b97bc54a0 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:27.037799 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ecf75647-95b2-437e-9410-2a2b97bc54a0 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:27.038229 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ecf75647-95b2-437e-9410-2a2b97bc54a0 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:27.196730 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-ecf75647-95b2-437e-9410-2a2b97bc54a0 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:27.205241 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-ecf75647-95b2-437e-9410-2a2b97bc54a0 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.183833 Oct 20 13:36:27.205854 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 69/136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:27 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:27.725784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2d77e548-0761-4360-8266-0e9821702b3e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:27.726388 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2d77e548-0761-4360-8266-0e9821702b3e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:27.736326 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d77e548-0761-4360-8266-0e9821702b3e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:27.736817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d77e548-0761-4360-8266-0e9821702b3e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:27.738465 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d77e548-0761-4360-8266-0e9821702b3e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:27.739168 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d77e548-0761-4360-8266-0e9821702b3e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:27.739619 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d77e548-0761-4360-8266-0e9821702b3e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:27.740038 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d77e548-0761-4360-8266-0e9821702b3e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:27.846444 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:27.847658 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:27.857259 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:27.857491 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:27.857919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:27.858748 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:27.859405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:27.859821 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:28.022087 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2d77e548-0761-4360-8266-0e9821702b3e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:28.030718 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2d77e548-0761-4360-8266-0e9821702b3e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.309706 Oct 20 13:36:28.035520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 68/137] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:27 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:28.046959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2314524c-bd28-499f-a3b8-b2653d62d942 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:28.047593 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2314524c-bd28-499f-a3b8-b2653d62d942 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:28.062254 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2314524c-bd28-499f-a3b8-b2653d62d942 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:28.062989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2314524c-bd28-499f-a3b8-b2653d62d942 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:28.063996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2314524c-bd28-499f-a3b8-b2653d62d942 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:28.065023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2314524c-bd28-499f-a3b8-b2653d62d942 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:28.067080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2314524c-bd28-499f-a3b8-b2653d62d942 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:28.067760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2314524c-bd28-499f-a3b8-b2653d62d942 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:28.098837 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:28.113591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:28.116772 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:28.121489 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-933ca795-c5cd-4753-b4c1-639c212f4e7d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.275709 Oct 20 13:36:28.122070 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 70/138] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:27 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:28.229712 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b5d08364-a3eb-43b1-911b-6abe29c821b9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:28.230684 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b5d08364-a3eb-43b1-911b-6abe29c821b9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:28.238861 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b5d08364-a3eb-43b1-911b-6abe29c821b9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:28.239854 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b5d08364-a3eb-43b1-911b-6abe29c821b9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:28.240522 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b5d08364-a3eb-43b1-911b-6abe29c821b9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:28.241480 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b5d08364-a3eb-43b1-911b-6abe29c821b9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:28.242144 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b5d08364-a3eb-43b1-911b-6abe29c821b9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:28.243495 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b5d08364-a3eb-43b1-911b-6abe29c821b9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:28.524361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b5d08364-a3eb-43b1-911b-6abe29c821b9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:28.535361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b5d08364-a3eb-43b1-911b-6abe29c821b9 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.308569 Oct 20 13:36:28.536123 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 71/139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:28 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:28.597714 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2314524c-bd28-499f-a3b8-b2653d62d942 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:28.610871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2314524c-bd28-499f-a3b8-b2653d62d942 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.573388 Oct 20 13:36:28.611347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 69/140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:28 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:29.063803 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-28193070-cb72-474c-8d14-407146e14bff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:29.064512 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-28193070-cb72-474c-8d14-407146e14bff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:29.071805 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-28193070-cb72-474c-8d14-407146e14bff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:29.072430 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-28193070-cb72-474c-8d14-407146e14bff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:29.072822 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-28193070-cb72-474c-8d14-407146e14bff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:29.073720 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-28193070-cb72-474c-8d14-407146e14bff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:29.074286 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-28193070-cb72-474c-8d14-407146e14bff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:29.074904 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-28193070-cb72-474c-8d14-407146e14bff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:29.147945 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:29.149037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:29.156288 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:29.156788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:29.157577 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:29.158281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:29.158870 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:29.159860 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:29.233781 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-28193070-cb72-474c-8d14-407146e14bff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:29.244235 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-28193070-cb72-474c-8d14-407146e14bff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1362 microversion: 2.1 time: 0.184474 Oct 20 13:36:29.248277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 72/141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:29 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:29.441395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:29.449184 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:29.451301 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:29.452442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9c3992cc-de74-4523-8ab8-66502f5ae0f3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.309050 Oct 20 13:36:29.453794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 70/142] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:29 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:29.562433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a05bce93-d045-45ec-aaf9-28298e2d4db5 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:29.563166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a05bce93-d045-45ec-aaf9-28298e2d4db5 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:29.569356 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a05bce93-d045-45ec-aaf9-28298e2d4db5 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:29.570213 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a05bce93-d045-45ec-aaf9-28298e2d4db5 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:29.570329 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a05bce93-d045-45ec-aaf9-28298e2d4db5 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:29.571033 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a05bce93-d045-45ec-aaf9-28298e2d4db5 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:29.571488 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a05bce93-d045-45ec-aaf9-28298e2d4db5 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:29.571906 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a05bce93-d045-45ec-aaf9-28298e2d4db5 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:29.641879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1b395368-df02-422a-a747-702a62b2e276 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:29.643307 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1b395368-df02-422a-a747-702a62b2e276 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:29.652129 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b395368-df02-422a-a747-702a62b2e276 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:29.652618 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b395368-df02-422a-a747-702a62b2e276 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:29.653092 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b395368-df02-422a-a747-702a62b2e276 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:29.653784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b395368-df02-422a-a747-702a62b2e276 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:29.654834 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b395368-df02-422a-a747-702a62b2e276 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:29.655171 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b395368-df02-422a-a747-702a62b2e276 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:29.727606 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a05bce93-d045-45ec-aaf9-28298e2d4db5 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:29.738413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a05bce93-d045-45ec-aaf9-28298e2d4db5 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.180169 Oct 20 13:36:29.741746 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 73/143] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:29 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:29.855098 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1b395368-df02-422a-a747-702a62b2e276 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:29.863976 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1b395368-df02-422a-a747-702a62b2e276 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.229791 Oct 20 13:36:29.864549 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 71/144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:29 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:30.273209 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-72af2f0e-3096-4228-8f56-d959b47d025d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:30.273843 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-72af2f0e-3096-4228-8f56-d959b47d025d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:30.280052 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72af2f0e-3096-4228-8f56-d959b47d025d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:30.280541 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72af2f0e-3096-4228-8f56-d959b47d025d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:30.281002 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72af2f0e-3096-4228-8f56-d959b47d025d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:30.281923 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72af2f0e-3096-4228-8f56-d959b47d025d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:30.282533 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72af2f0e-3096-4228-8f56-d959b47d025d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:30.282938 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72af2f0e-3096-4228-8f56-d959b47d025d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:30.446217 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-72af2f0e-3096-4228-8f56-d959b47d025d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:30.455620 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-72af2f0e-3096-4228-8f56-d959b47d025d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1547 microversion: 2.1 time: 0.187859 Oct 20 13:36:30.456275 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 74/145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:30 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1547 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:30.479517 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:30.480190 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:30.488841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:30.489355 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:30.489778 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:30.490470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:30.490921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:30.494020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a6f3f0e2-598d-4834-acf9-36c5a08ac4b2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:30.494231 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a6f3f0e2-598d-4834-acf9-36c5a08ac4b2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:30.502310 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:30.509559 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6f3f0e2-598d-4834-acf9-36c5a08ac4b2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:30.510056 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6f3f0e2-598d-4834-acf9-36c5a08ac4b2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:30.510489 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6f3f0e2-598d-4834-acf9-36c5a08ac4b2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:30.511238 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6f3f0e2-598d-4834-acf9-36c5a08ac4b2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:30.516127 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6f3f0e2-598d-4834-acf9-36c5a08ac4b2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:30.516600 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6f3f0e2-598d-4834-acf9-36c5a08ac4b2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:30.643278 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a6f3f0e2-598d-4834-acf9-36c5a08ac4b2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158772 Oct 20 13:36:30.645596 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 75/146] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 20 13:36:30 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:36:30.730567 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:30.743088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:30.744888 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:30.746198 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-eecf4e17-d3ba-49b3-92f1-5b47205ff05d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.271394 Oct 20 13:36:30.746892 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 72/147] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:30 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:36:30.765993 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f697da67-0cad-40ab-a80a-1c5bb6d83d7e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:30.766607 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-f697da67-0cad-40ab-a80a-1c5bb6d83d7e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:30.773373 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f697da67-0cad-40ab-a80a-1c5bb6d83d7e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:30.774382 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f697da67-0cad-40ab-a80a-1c5bb6d83d7e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:30.775092 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f697da67-0cad-40ab-a80a-1c5bb6d83d7e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:30.776115 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f697da67-0cad-40ab-a80a-1c5bb6d83d7e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:30.776708 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f697da67-0cad-40ab-a80a-1c5bb6d83d7e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:30.777465 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f697da67-0cad-40ab-a80a-1c5bb6d83d7e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:30.891714 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e29e7d7d-9d2e-4360-8e9f-e5eab9711404 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:30.892458 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e29e7d7d-9d2e-4360-8e9f-e5eab9711404 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:30.903825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e29e7d7d-9d2e-4360-8e9f-e5eab9711404 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:30.903825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e29e7d7d-9d2e-4360-8e9f-e5eab9711404 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:30.903825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e29e7d7d-9d2e-4360-8e9f-e5eab9711404 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:30.903825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e29e7d7d-9d2e-4360-8e9f-e5eab9711404 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:30.904701 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e29e7d7d-9d2e-4360-8e9f-e5eab9711404 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:30.905207 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e29e7d7d-9d2e-4360-8e9f-e5eab9711404 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:31.106502 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e29e7d7d-9d2e-4360-8e9f-e5eab9711404 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:31.121205 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e29e7d7d-9d2e-4360-8e9f-e5eab9711404 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.234552 Oct 20 13:36:31.122100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 73/148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:30 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:31.130964 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-f697da67-0cad-40ab-a80a-1c5bb6d83d7e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:31.144110 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-f697da67-0cad-40ab-a80a-1c5bb6d83d7e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.381133 Oct 20 13:36:31.144556 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 76/149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:30 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:31.774394 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:31.775125 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:31.781764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:31.782335 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:31.782996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:31.783914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:31.785176 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:31.785670 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:31.964194 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:31.977525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:31.979237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:31.981261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ab7e1a99-a87a-4c9c-af64-e03238ccc0a0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.211009 Oct 20 13:36:31.985248 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 74/150] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:31 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:36:32.145101 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0527c74e-d69a-45cf-b404-a156ee07b66c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:32.145818 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0527c74e-d69a-45cf-b404-a156ee07b66c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:32.155482 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0527c74e-d69a-45cf-b404-a156ee07b66c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:32.157523 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0527c74e-d69a-45cf-b404-a156ee07b66c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:32.158176 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0527c74e-d69a-45cf-b404-a156ee07b66c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:32.170563 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0527c74e-d69a-45cf-b404-a156ee07b66c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:32.178585 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0527c74e-d69a-45cf-b404-a156ee07b66c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:32.179842 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0527c74e-d69a-45cf-b404-a156ee07b66c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:32.187528 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9a130dab-dbb3-4f9b-ae72-230518c8b358 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:32.188332 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9a130dab-dbb3-4f9b-ae72-230518c8b358 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:32.206909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a130dab-dbb3-4f9b-ae72-230518c8b358 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:32.208222 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a130dab-dbb3-4f9b-ae72-230518c8b358 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:32.208909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a130dab-dbb3-4f9b-ae72-230518c8b358 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:32.209781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a130dab-dbb3-4f9b-ae72-230518c8b358 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:32.211232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a130dab-dbb3-4f9b-ae72-230518c8b358 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:32.212923 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a130dab-dbb3-4f9b-ae72-230518c8b358 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:32.575495 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0527c74e-d69a-45cf-b404-a156ee07b66c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:32.589239 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0527c74e-d69a-45cf-b404-a156ee07b66c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.444745 Oct 20 13:36:32.590864 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 77/151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:32 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:32.669668 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9a130dab-dbb3-4f9b-ae72-230518c8b358 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:32.690830 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9a130dab-dbb3-4f9b-ae72-230518c8b358 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.523222 Oct 20 13:36:32.694286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 75/152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:32 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:32.816252 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-e780d918-7873-4ca8-b255-655d5e29b24c req-1e076b44-fd84-4dcd-ade5-22f69dc97561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19146772-f7e2-43d8-b7b3-3c365f024e54", "tag": "20c71ca9-62f4-4658-828a-7e49ec9d9631"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:32.827524 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-e780d918-7873-4ca8-b255-655d5e29b24c req-1e076b44-fd84-4dcd-ade5-22f69dc97561 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:32.828296 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-e780d918-7873-4ca8-b255-655d5e29b24c req-1e076b44-fd84-4dcd-ade5-22f69dc97561 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:32.828920 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-e780d918-7873-4ca8-b255-655d5e29b24c req-1e076b44-fd84-4dcd-ade5-22f69dc97561 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:32.855725 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-e780d918-7873-4ca8-b255-655d5e29b24c req-1e076b44-fd84-4dcd-ade5-22f69dc97561 service nova] Creating event network-changed:20c71ca9-62f4-4658-828a-7e49ec9d9631 for instance 19146772-f7e2-43d8-b7b3-3c365f024e54 on hv-cinder-86213 Oct 20 13:36:32.862069 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-e780d918-7873-4ca8-b255-655d5e29b24c req-1e076b44-fd84-4dcd-ade5-22f69dc97561 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051090 Oct 20 13:36:32.863439 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 78/153] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:36:33.011585 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:33.012227 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:33.021448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:33.023961 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:33.024508 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:33.026027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:33.028517 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:33.029055 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:33.070091 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-83845fee-e3e6-4e98-ace2-ad4cd6052468 req-0fa2b231-364e-4bb9-aa58-f0878fee6962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417ecff7-87f2-4818-9e78-a698e13fe46d", "name": "network-vif-plugged", "status": "completed", "tag": "aa084c37-d6d3-49cd-83ce-62d9de1a28b8"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:33.090154 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-83845fee-e3e6-4e98-ace2-ad4cd6052468 req-0fa2b231-364e-4bb9-aa58-f0878fee6962 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:33.090871 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-83845fee-e3e6-4e98-ace2-ad4cd6052468 req-0fa2b231-364e-4bb9-aa58-f0878fee6962 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:33.091508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-83845fee-e3e6-4e98-ace2-ad4cd6052468 req-0fa2b231-364e-4bb9-aa58-f0878fee6962 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:33.109847 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-83845fee-e3e6-4e98-ace2-ad4cd6052468 req-0fa2b231-364e-4bb9-aa58-f0878fee6962 service nova] Creating event network-vif-plugged:aa084c37-d6d3-49cd-83ce-62d9de1a28b8 for instance 417ecff7-87f2-4818-9e78-a698e13fe46d on hv-cinder-86213 Oct 20 13:36:33.116252 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-83845fee-e3e6-4e98-ace2-ad4cd6052468 req-0fa2b231-364e-4bb9-aa58-f0878fee6962 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050691 Oct 20 13:36:33.117619 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 79/154] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:36:33.273048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:33.285597 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:33.287645 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:33.288950 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-96ffc5e1-15af-4c7c-bd59-9ce26781f6ee tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.281265 Oct 20 13:36:33.302818 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 76/155] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:33 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:33.616165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-34b0777b-467f-48d8-b659-952d90c1f85b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:33.616892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-34b0777b-467f-48d8-b659-952d90c1f85b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:33.624323 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-34b0777b-467f-48d8-b659-952d90c1f85b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:33.624803 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-34b0777b-467f-48d8-b659-952d90c1f85b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:33.625469 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-34b0777b-467f-48d8-b659-952d90c1f85b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:33.626438 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-34b0777b-467f-48d8-b659-952d90c1f85b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:33.626938 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-34b0777b-467f-48d8-b659-952d90c1f85b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:33.627522 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-34b0777b-467f-48d8-b659-952d90c1f85b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:33.716602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7a9a72f9-efa2-407b-aea4-b8a39c3e9e2b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:33.717771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7a9a72f9-efa2-407b-aea4-b8a39c3e9e2b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:33.731735 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a9a72f9-efa2-407b-aea4-b8a39c3e9e2b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:33.732161 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a9a72f9-efa2-407b-aea4-b8a39c3e9e2b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:33.734038 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a9a72f9-efa2-407b-aea4-b8a39c3e9e2b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:33.738503 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a9a72f9-efa2-407b-aea4-b8a39c3e9e2b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:33.739155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a9a72f9-efa2-407b-aea4-b8a39c3e9e2b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:33.739819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a9a72f9-efa2-407b-aea4-b8a39c3e9e2b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:33.892202 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-34b0777b-467f-48d8-b659-952d90c1f85b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:33.904129 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-34b0777b-467f-48d8-b659-952d90c1f85b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.293461 Oct 20 13:36:33.905329 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 80/156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:33 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:33.952239 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7a9a72f9-efa2-407b-aea4-b8a39c3e9e2b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:33.962302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7a9a72f9-efa2-407b-aea4-b8a39c3e9e2b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.251254 Oct 20 13:36:33.963086 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 77/157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:33 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:34.315778 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:34.316373 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:34.325595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:34.327199 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:34.328423 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:34.330726 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:34.332354 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:34.333481 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:34.727679 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:34.737843 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:34.739639 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:34.741109 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-98ada067-66cf-46c5-858c-88df03a36f66 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.429367 Oct 20 13:36:34.753449 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 81/158] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:34 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:34.928329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2ef829d7-d7d8-4903-8045-a40a0303f023 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:34.928979 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2ef829d7-d7d8-4903-8045-a40a0303f023 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:34.935453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ef829d7-d7d8-4903-8045-a40a0303f023 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:34.935941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ef829d7-d7d8-4903-8045-a40a0303f023 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:34.936370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ef829d7-d7d8-4903-8045-a40a0303f023 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:34.937090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ef829d7-d7d8-4903-8045-a40a0303f023 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:34.937541 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ef829d7-d7d8-4903-8045-a40a0303f023 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:34.937961 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ef829d7-d7d8-4903-8045-a40a0303f023 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:34.985270 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5f08660b-4f42-4229-931f-49f6773b8528 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:34.989397 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5f08660b-4f42-4229-931f-49f6773b8528 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:34.991681 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=97 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:34.997680 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f08660b-4f42-4229-931f-49f6773b8528 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:34.999352 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f08660b-4f42-4229-931f-49f6773b8528 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:34.999792 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f08660b-4f42-4229-931f-49f6773b8528 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:35.000497 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f08660b-4f42-4229-931f-49f6773b8528 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:35.000975 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f08660b-4f42-4229-931f-49f6773b8528 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:35.001391 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f08660b-4f42-4229-931f-49f6773b8528 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:35.124720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2ef829d7-d7d8-4903-8045-a40a0303f023 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:35.134034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2ef829d7-d7d8-4903-8045-a40a0303f023 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1368 microversion: 2.1 time: 0.210461 Oct 20 13:36:35.134880 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 78/159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:34 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:35.155836 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5f08660b-4f42-4229-931f-49f6773b8528 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:35.167677 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5f08660b-4f42-4229-931f-49f6773b8528 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.186394 Oct 20 13:36:35.168497 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 82/160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:34 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:35.767108 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:35.767834 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:35.774711 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:35.775424 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:35.775850 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:35.776731 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:35.777258 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:35.777866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:36.091518 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:36.110486 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:36.112691 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:36.114936 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4fe99a22-e586-4766-a75f-30e607e81b67 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.351428 Oct 20 13:36:36.116314 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 79/161] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:35 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:36.158656 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-290d159f-039a-4231-ab58-9066b01c3224 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:36.159947 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-290d159f-039a-4231-ab58-9066b01c3224 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:36.166280 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-290d159f-039a-4231-ab58-9066b01c3224 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:36.166845 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-290d159f-039a-4231-ab58-9066b01c3224 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:36.167345 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-290d159f-039a-4231-ab58-9066b01c3224 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:36.168199 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-290d159f-039a-4231-ab58-9066b01c3224 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:36.168724 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-290d159f-039a-4231-ab58-9066b01c3224 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:36.169235 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-290d159f-039a-4231-ab58-9066b01c3224 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:36.191569 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1e2697fc-3e6c-4293-95ab-7564b8660dd2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:36.192253 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1e2697fc-3e6c-4293-95ab-7564b8660dd2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:36.194218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=96 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:36.202679 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e2697fc-3e6c-4293-95ab-7564b8660dd2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:36.203760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e2697fc-3e6c-4293-95ab-7564b8660dd2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:36.206321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e2697fc-3e6c-4293-95ab-7564b8660dd2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:36.209792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e2697fc-3e6c-4293-95ab-7564b8660dd2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:36.210455 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e2697fc-3e6c-4293-95ab-7564b8660dd2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:36.211123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e2697fc-3e6c-4293-95ab-7564b8660dd2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:36.441077 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-290d159f-039a-4231-ab58-9066b01c3224 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:36.450639 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-290d159f-039a-4231-ab58-9066b01c3224 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1557 microversion: 2.1 time: 0.296199 Oct 20 13:36:36.451557 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 83/162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:36 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1557 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:36.478209 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e26e902f-8b93-4e88-96e0-3f4b8466a975 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:36.479059 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e26e902f-8b93-4e88-96e0-3f4b8466a975 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:36.488344 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e26e902f-8b93-4e88-96e0-3f4b8466a975 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:36.489044 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e26e902f-8b93-4e88-96e0-3f4b8466a975 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:36.489663 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e26e902f-8b93-4e88-96e0-3f4b8466a975 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:36.490395 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e26e902f-8b93-4e88-96e0-3f4b8466a975 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:36.490906 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e26e902f-8b93-4e88-96e0-3f4b8466a975 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:36.491331 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e26e902f-8b93-4e88-96e0-3f4b8466a975 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:36.579257 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e26e902f-8b93-4e88-96e0-3f4b8466a975 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105850 Oct 20 13:36:36.584857 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 84/163] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 20 13:36:36 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:36:36.698853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1e2697fc-3e6c-4293-95ab-7564b8660dd2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:36.706518 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1e2697fc-3e6c-4293-95ab-7564b8660dd2 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1315 microversion: 2.1 time: 0.518809 Oct 20 13:36:36.707824 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 80/164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:36 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:37.146510 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:37.147117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:37.155667 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:37.156378 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:37.156952 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:37.157661 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:37.158360 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:37.159410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:37.242581 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-9ab0178a-c58e-48c6-9932-61290616d0e3 req-cb4cc15e-000b-408f-a9d2-add9a9de2586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b9ae5b-1e55-409f-9a61-b1e2a47d1b58", "name": "network-vif-plugged", "status": "completed", "tag": "c4329cd6-ac99-4465-b271-c87f6eb593c4"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:37.260941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-9ab0178a-c58e-48c6-9932-61290616d0e3 req-cb4cc15e-000b-408f-a9d2-add9a9de2586 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:37.263302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-9ab0178a-c58e-48c6-9932-61290616d0e3 req-cb4cc15e-000b-408f-a9d2-add9a9de2586 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:37.263847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-9ab0178a-c58e-48c6-9932-61290616d0e3 req-cb4cc15e-000b-408f-a9d2-add9a9de2586 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:37.277553 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-9ab0178a-c58e-48c6-9932-61290616d0e3 req-cb4cc15e-000b-408f-a9d2-add9a9de2586 service nova] Creating event network-vif-plugged:c4329cd6-ac99-4465-b271-c87f6eb593c4 for instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 on hv-cinder-86213 Oct 20 13:36:37.282560 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-9ab0178a-c58e-48c6-9932-61290616d0e3 req-cb4cc15e-000b-408f-a9d2-add9a9de2586 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043946 Oct 20 13:36:37.283150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 81/165] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:36:37.391977 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:37.402974 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:37.402974 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:37.404206 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-8da54a78-57a4-45ee-ab8d-64299e4680c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.262310 Oct 20 13:36:37.404824 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 85/166] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:37 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:37.731176 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e24a3595-7280-4533-8450-5383135d0817 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:37.732234 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e24a3595-7280-4533-8450-5383135d0817 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:37.746014 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e24a3595-7280-4533-8450-5383135d0817 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:37.746902 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e24a3595-7280-4533-8450-5383135d0817 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:37.747562 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e24a3595-7280-4533-8450-5383135d0817 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:37.749435 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e24a3595-7280-4533-8450-5383135d0817 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:37.750232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e24a3595-7280-4533-8450-5383135d0817 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:37.750871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e24a3595-7280-4533-8450-5383135d0817 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:37.835772 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-3ef3da06-20ac-4796-a017-0b7430a6ab23 req-c15bda4f-5e39-4865-9df4-7bcc3764fdcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07ca6e8-83ee-4690-97c1-7cc13774d5ea", "tag": "945c0530-b30a-4e15-a586-dfaaa2fdd6ae"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:37.876638 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-3ef3da06-20ac-4796-a017-0b7430a6ab23 req-c15bda4f-5e39-4865-9df4-7bcc3764fdcf service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:37.893020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-3ef3da06-20ac-4796-a017-0b7430a6ab23 req-c15bda4f-5e39-4865-9df4-7bcc3764fdcf service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:37.894075 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-3ef3da06-20ac-4796-a017-0b7430a6ab23 req-c15bda4f-5e39-4865-9df4-7bcc3764fdcf service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:37.946423 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-3ef3da06-20ac-4796-a017-0b7430a6ab23 req-c15bda4f-5e39-4865-9df4-7bcc3764fdcf service nova] Creating event network-changed:945c0530-b30a-4e15-a586-dfaaa2fdd6ae for instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea on hv-cinder-86213 Oct 20 13:36:37.969444 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-3ef3da06-20ac-4796-a017-0b7430a6ab23 req-c15bda4f-5e39-4865-9df4-7bcc3764fdcf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138014 Oct 20 13:36:37.972830 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 86/167] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:36:38.229809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e24a3595-7280-4533-8450-5383135d0817 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:38.240678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e24a3595-7280-4533-8450-5383135d0817 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1502 microversion: 2.1 time: 0.513596 Oct 20 13:36:38.242092 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 82/168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:37 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1502 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:38.431195 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:38.431884 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:38.442050 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:38.442570 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:38.443038 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:38.449617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:38.450113 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:38.450537 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:38.660414 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:38.671802 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:38.674286 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:38.676097 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a9db4028-21fc-4607-ba3b-ca49b08696eb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.249113 Oct 20 13:36:38.677499 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 87/169] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:38 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:36:39.703694 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:39.704295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:39.712551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:39.713074 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:39.713503 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:39.714201 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:39.714647 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:39.715076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:39.905669 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:39.921047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:39.928542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:39.929677 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-98b2e2f8-b270-4271-8626-d1537970b12d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1406 microversion: 2.20 time: 0.229957 Oct 20 13:36:39.930237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 83/170] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:39 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:39.966075 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d925df60-1e2f-4adc-8bac-4ce6eeb9652e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d4362a4-ab7d-470b-adfd-1fd710f0bd31"}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:39.969393 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d925df60-1e2f-4adc-8bac-4ce6eeb9652e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:39.976403 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d925df60-1e2f-4adc-8bac-4ce6eeb9652e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:39.976907 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d925df60-1e2f-4adc-8bac-4ce6eeb9652e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:39.977379 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d925df60-1e2f-4adc-8bac-4ce6eeb9652e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:39.978090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d925df60-1e2f-4adc-8bac-4ce6eeb9652e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:39.978531 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d925df60-1e2f-4adc-8bac-4ce6eeb9652e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:39.978951 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d925df60-1e2f-4adc-8bac-4ce6eeb9652e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:39.982884 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=100 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:40.653422 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d925df60-1e2f-4adc-8bac-4ce6eeb9652e tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "POST /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691089 Oct 20 13:36:40.656979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 88/171] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:36:39 2022] POST /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:36:40.958907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:40.960993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:40.984405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:40.984975 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:40.985519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:40.986412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:40.987205 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:40.987965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:40.993755 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=100 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:41.215230 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:41.224887 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:41.226993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:41.228955 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b489cce5-ced2-4e1b-8e9a-f451e2906a63 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1598 microversion: 2.20 time: 0.275882 Oct 20 13:36:41.229731 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 84/172] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:36:40 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1598 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:36:41.263720 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-73eabbaf-b0df-44a9-9b6f-cc293a729fae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:41.265156 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-73eabbaf-b0df-44a9-9b6f-cc293a729fae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:41.281604 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73eabbaf-b0df-44a9-9b6f-cc293a729fae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:41.283336 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73eabbaf-b0df-44a9-9b6f-cc293a729fae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:41.284772 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73eabbaf-b0df-44a9-9b6f-cc293a729fae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:41.285740 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73eabbaf-b0df-44a9-9b6f-cc293a729fae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:41.286637 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73eabbaf-b0df-44a9-9b6f-cc293a729fae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:41.287523 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73eabbaf-b0df-44a9-9b6f-cc293a729fae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:41.426962 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-73eabbaf-b0df-44a9-9b6f-cc293a729fae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.166973 Oct 20 13:36:41.437325 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 89/173] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 20 13:36:41 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:36:43.059576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-8a701375-6b40-4405-b654-7f7bf4357456 req-4b8834b4-de73-4710-a438-d79c3f68f0ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b9ae5b-1e55-409f-9a61-b1e2a47d1b58", "tag": "c4329cd6-ac99-4465-b271-c87f6eb593c4"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:43.070332 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-8a701375-6b40-4405-b654-7f7bf4357456 req-4b8834b4-de73-4710-a438-d79c3f68f0ec service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:43.070631 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-8a701375-6b40-4405-b654-7f7bf4357456 req-4b8834b4-de73-4710-a438-d79c3f68f0ec service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:43.071221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-8a701375-6b40-4405-b654-7f7bf4357456 req-4b8834b4-de73-4710-a438-d79c3f68f0ec service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:43.087844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-8a701375-6b40-4405-b654-7f7bf4357456 req-4b8834b4-de73-4710-a438-d79c3f68f0ec service nova] Creating event network-changed:c4329cd6-ac99-4465-b271-c87f6eb593c4 for instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 on hv-cinder-86213 Oct 20 13:36:43.094285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-8a701375-6b40-4405-b654-7f7bf4357456 req-4b8834b4-de73-4710-a438-d79c3f68f0ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039035 Oct 20 13:36:43.096416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 85/174] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:36:50.657954 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a6a33062-aef9-4055-a29b-1312b5846638 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:50.663292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a6a33062-aef9-4055-a29b-1312b5846638 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:50.677226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6a33062-aef9-4055-a29b-1312b5846638 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:50.678617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6a33062-aef9-4055-a29b-1312b5846638 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:50.679051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6a33062-aef9-4055-a29b-1312b5846638 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:50.679925 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6a33062-aef9-4055-a29b-1312b5846638 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:50.680374 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6a33062-aef9-4055-a29b-1312b5846638 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:50.681022 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a6a33062-aef9-4055-a29b-1312b5846638 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:50.708722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a6a33062-aef9-4055-a29b-1312b5846638 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Going to try to terminate instance {{(pid=125447) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:36:50.823508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a6a33062-aef9-4055-a29b-1312b5846638 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "DELETE /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 204 len: 0 microversion: 2.1 time: 0.170649 Oct 20 13:36:50.824528 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 90/175] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:36:50 2022] DELETE /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:36:50.834046 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e3857b21-4f51-4e0a-bb73-6247570b635c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:50.834735 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e3857b21-4f51-4e0a-bb73-6247570b635c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:50.841206 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3857b21-4f51-4e0a-bb73-6247570b635c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:50.841684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3857b21-4f51-4e0a-bb73-6247570b635c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:50.842107 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3857b21-4f51-4e0a-bb73-6247570b635c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:50.842792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3857b21-4f51-4e0a-bb73-6247570b635c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:50.843239 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3857b21-4f51-4e0a-bb73-6247570b635c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:50.843656 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3857b21-4f51-4e0a-bb73-6247570b635c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:51.001928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e3857b21-4f51-4e0a-bb73-6247570b635c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:51.010810 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e3857b21-4f51-4e0a-bb73-6247570b635c tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1554 microversion: 2.1 time: 0.181807 Oct 20 13:36:51.011378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 86/176] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:50 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:36:52.035573 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-96e15766-4698-452f-9724-fd11533f3ebe tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:52.037055 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-96e15766-4698-452f-9724-fd11533f3ebe tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:52.043931 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96e15766-4698-452f-9724-fd11533f3ebe tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:52.044415 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96e15766-4698-452f-9724-fd11533f3ebe tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:52.044847 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96e15766-4698-452f-9724-fd11533f3ebe tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:52.045609 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96e15766-4698-452f-9724-fd11533f3ebe tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:52.046052 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96e15766-4698-452f-9724-fd11533f3ebe tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:52.046656 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96e15766-4698-452f-9724-fd11533f3ebe tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:52.228287 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-96e15766-4698-452f-9724-fd11533f3ebe tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:52.243187 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-96e15766-4698-452f-9724-fd11533f3ebe tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1554 microversion: 2.1 time: 0.210884 Oct 20 13:36:52.245027 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 91/177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:52 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:53.270508 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2a44fdb7-ff5e-4bbe-a505-4a20114e697b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:53.271123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2a44fdb7-ff5e-4bbe-a505-4a20114e697b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:53.277967 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a44fdb7-ff5e-4bbe-a505-4a20114e697b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:53.279899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a44fdb7-ff5e-4bbe-a505-4a20114e697b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:53.280602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a44fdb7-ff5e-4bbe-a505-4a20114e697b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:53.281526 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a44fdb7-ff5e-4bbe-a505-4a20114e697b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:53.282093 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a44fdb7-ff5e-4bbe-a505-4a20114e697b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:53.282640 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a44fdb7-ff5e-4bbe-a505-4a20114e697b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:53.676342 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2a44fdb7-ff5e-4bbe-a505-4a20114e697b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:53.690556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2a44fdb7-ff5e-4bbe-a505-4a20114e697b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1554 microversion: 2.1 time: 0.427631 Oct 20 13:36:53.698706 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 87/178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:53 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1554 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:53.714779 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-7059fc9c-1c63-46c9-83d5-0ede35e8df96 req-1ae40a47-7c3f-4e20-a4d8-9050a2bd3c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417ecff7-87f2-4818-9e78-a698e13fe46d", "name": "network-vif-deleted", "tag": "aa084c37-d6d3-49cd-83ce-62d9de1a28b8"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:36:53.730088 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-7059fc9c-1c63-46c9-83d5-0ede35e8df96 req-1ae40a47-7c3f-4e20-a4d8-9050a2bd3c2f service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:53.732478 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-7059fc9c-1c63-46c9-83d5-0ede35e8df96 req-1ae40a47-7c3f-4e20-a4d8-9050a2bd3c2f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:53.732992 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-7059fc9c-1c63-46c9-83d5-0ede35e8df96 req-1ae40a47-7c3f-4e20-a4d8-9050a2bd3c2f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:53.753518 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-7059fc9c-1c63-46c9-83d5-0ede35e8df96 req-1ae40a47-7c3f-4e20-a4d8-9050a2bd3c2f service nova] Creating event network-vif-deleted:aa084c37-d6d3-49cd-83ce-62d9de1a28b8 for instance 417ecff7-87f2-4818-9e78-a698e13fe46d on hv-cinder-86213 Oct 20 13:36:53.759636 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-7059fc9c-1c63-46c9-83d5-0ede35e8df96 req-1ae40a47-7c3f-4e20-a4d8-9050a2bd3c2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049144 Oct 20 13:36:53.760592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 92/179] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:36:54.715285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:54.715943 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:54.723420 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:54.726754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:54.727219 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:54.727927 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:54.728380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:54.728803 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:54.785276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:54.785935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:54.786538 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:54.786993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lazy-loading 'fault' on Instance uuid 417ecff7-87f2-4818-9e78-a698e13fe46d {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:36:54.844692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6085945ca3304bc99b4d9ca8a37d5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ecd40d6914036b80dfcf74eada323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:36:54.853119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-af1c7e26-e0bd-447c-9b12-dece52e33cb1 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 200 len: 1305 microversion: 2.1 time: 0.141807 Oct 20 13:36:54.854003 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 88/180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:54 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 1305 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:36:55.876607 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:55.878237 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:55.885289 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:55.885766 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:55.886192 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:55.886880 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:55.887323 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:55.887726 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:55.903860 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] HTTP exception thrown: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Request method failure captured: Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d HTTP/1.1 Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 0 Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6zoREPcs-2tZvyXYlJ30F-f9IfhSkcERraZzvS7yVcso1Uk05jbjg3LLbGYwpJ2FGZcCibwm93HIOuw3h_DbZ4AQk2AmJC1vD6n8pW1QcvjyYbJ1hU1VHCyuMRe8lLsd7g-ROUtRC-GMM__oWLyZwl2ignD8XEJkHsBQ4_7VCc3Tk Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: 4e1ecd40d6914036b80dfcf74eada323 Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:36:55.909358 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: 4e1ecd40d6914036b80dfcf74eada323 Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-DeleteServersTestJSON-332774525-project Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 6085945ca3304bc99b4d9ca8a37d5319 Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-DeleteServersTestJSON-332774525-project Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: > Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:55.910852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'id': '417ecff7-87f2-4818-9e78-a698e13fe46d'} Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:36:55.911634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:55.912979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:36:55.914171 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Returning 404 to user: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:36:55.914171 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-c263a6bb-4fd1-484a-a85a-6fad25ff02f8 tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 404 len: 111 microversion: 2.1 time: 0.038312 Oct 20 13:36:55.914171 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 93/181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:55 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:36:56.037131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:56.039334 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:56.045400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:56.046114 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:56.046712 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:56.047605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:56.048116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:56.048823 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:56.093779 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] HTTP exception thrown: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Request method failure captured: Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d/os-volume_attachments HTTP/1.1 Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6zoREPcs-2tZvyXYlJ30F-f9IfhSkcERraZzvS7yVcso1Uk05jbjg3LLbGYwpJ2FGZcCibwm93HIOuw3h_DbZ4AQk2AmJC1vD6n8pW1QcvjyYbJ1hU1VHCyuMRe8lLsd7g-ROUtRC-GMM__oWLyZwl2ignD8XEJkHsBQ4_7VCc3Tk Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 4e1ecd40d6914036b80dfcf74eada323 Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:36:56.099934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 4e1ecd40d6914036b80dfcf74eada323 Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-DeleteServersTestJSON-332774525-project Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 6085945ca3304bc99b4d9ca8a37d5319 Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-DeleteServersTestJSON-332774525-project Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:56.101297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'server_id': '417ecff7-87f2-4818-9e78-a698e13fe46d'} Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:36:56.102226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:56.103599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:36:56.107033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Returning 404 to user: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:36:56.108050 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5a01e9e7-2867-4738-9dc7-dce0759f557b tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.075562 Oct 20 13:36:56.109096 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 89/182] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:36:56 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d/os-volume_attachments => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:36:57.374346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:57.374797 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:57.382065 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:57.382548 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:57.382977 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:57.383673 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:57.384124 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:57.384548 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:57.402611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] HTTP exception thrown: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Request method failure captured: Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: DELETE /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d HTTP/1.1 Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 0 Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6zoREPcs-2tZvyXYlJ30F-f9IfhSkcERraZzvS7yVcso1Uk05jbjg3LLbGYwpJ2FGZcCibwm93HIOuw3h_DbZ4AQk2AmJC1vD6n8pW1QcvjyYbJ1hU1VHCyuMRe8lLsd7g-ROUtRC-GMM__oWLyZwl2ignD8XEJkHsBQ4_7VCc3Tk Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: 4e1ecd40d6914036b80dfcf74eada323 Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:36:57.404372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: 4e1ecd40d6914036b80dfcf74eada323 Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-DeleteServersTestJSON-332774525-project Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 6085945ca3304bc99b4d9ca8a37d5319 Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-DeleteServersTestJSON-332774525-project Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: > Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:57.405678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'id': '417ecff7-87f2-4818-9e78-a698e13fe46d'} Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:36:57.406416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:57.407433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:36:57.410887 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Returning 404 to user: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:36:57.410887 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-6793f980-5710-40ec-91e9-9154ea18dfab tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "DELETE /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 404 len: 111 microversion: 2.1 time: 0.036219 Oct 20 13:36:57.410887 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 94/183] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:36:57 2022] DELETE /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:36:57.415898 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:36:57.416641 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] [instance: 417ecff7-87f2-4818-9e78-a698e13fe46d] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:36:57.422609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:57.423084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:57.423614 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:57.424828 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:36:57.425535 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:36:57.426001 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:36:57.441329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] HTTP exception thrown: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Request method failure captured: Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d HTTP/1.1 Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6zoREPcs-2tZvyXYlJ30F-f9IfhSkcERraZzvS7yVcso1Uk05jbjg3LLbGYwpJ2FGZcCibwm93HIOuw3h_DbZ4AQk2AmJC1vD6n8pW1QcvjyYbJ1hU1VHCyuMRe8lLsd7g-ROUtRC-GMM__oWLyZwl2ignD8XEJkHsBQ4_7VCc3Tk Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 4e1ecd40d6914036b80dfcf74eada323 Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:36:57.443913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4e1ecd40d6914036b80dfcf74eada323"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 4e1ecd40d6914036b80dfcf74eada323 Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-DeleteServersTestJSON-332774525 Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-DeleteServersTestJSON-332774525-project Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 6085945ca3304bc99b4d9ca8a37d5319 Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-DeleteServersTestJSON-332774525-project Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:57.445524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '417ecff7-87f2-4818-9e78-a698e13fe46d'} Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:36:57.446630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. Oct 20 13:36:57.447996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:36:57.450770 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] Returning 404 to user: Instance 417ecff7-87f2-4818-9e78-a698e13fe46d could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:36:57.450770 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e00e1000-bbc6-4e07-8acf-711937a624da tempest-DeleteServersTestJSON-332774525 tempest-DeleteServersTestJSON-332774525-project] 10.222.0.23 "GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d" status: 404 len: 111 microversion: 2.1 time: 0.033419 Oct 20 13:36:57.450770 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 90/184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:36:57 2022] GET /compute/v2.1/servers/417ecff7-87f2-4818-9e78-a698e13fe46d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:37:08.910322 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:08.911070 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:09.033231 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1689868431", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:09.090467 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.network.neutron [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] validate_networks() for [('80f8d646-52cd-4c79-be89-0476981cc6e9', None, None, None, None, None)] {{(pid=125447) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:37:09.528745 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Flavor limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:37:09.529310 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Image limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:37:09.529780 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Flavor pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:37:09.530181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Image pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:37:09.530741 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:37:09.548587 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:09.549173 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:09.549609 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:09.550330 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:09.551020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:09.551625 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:09.570413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Getting quotas for project f36e9fb394944eb0a0c2c0075dbc937c. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:37:09.575509 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Getting quotas for user 2dd45d3b097c46c28eb94c5e0bd2a7a6 and project f36e9fb394944eb0a0c2c0075dbc937c. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:37:09.587311 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Going to run 1 instances... {{(pid=125447) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:37:09.589671 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125447) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:37:09.643176 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5335a259-b94d-4697-8740-6309d123889e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.738603 Oct 20 13:37:09.644336 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 95/185] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:37:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 13:37:09.655212 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-70c9ad0b-dda4-48b6-9ab1-7144ab0b19c8 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:09.656141 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-70c9ad0b-dda4-48b6-9ab1-7144ab0b19c8 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:09.659234 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=23 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:09.660044 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=30 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:09.719129 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-70c9ad0b-dda4-48b6-9ab1-7144ab0b19c8 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:09.728415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-70c9ad0b-dda4-48b6-9ab1-7144ab0b19c8 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1222 microversion: 2.1 time: 0.077121 Oct 20 13:37:09.729335 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 91/186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:09 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:09.799707 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1648323745", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:09.861162 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.network.neutron [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] validate_networks() for [('80f8d646-52cd-4c79-be89-0476981cc6e9', None, None, None, None, None)] {{(pid=125447) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:37:10.265829 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Flavor limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:37:10.266340 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Image limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:37:10.266752 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Flavor pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:37:10.267438 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Image pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:37:10.267529 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:37:10.278822 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:10.279294 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:10.279721 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:10.280437 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:10.280895 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:10.281473 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:10.300789 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Getting quotas for project f36e9fb394944eb0a0c2c0075dbc937c. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:37:10.305170 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Getting quotas for user 2dd45d3b097c46c28eb94c5e0bd2a7a6 and project f36e9fb394944eb0a0c2c0075dbc937c. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:37:10.317476 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Going to run 1 instances... {{(pid=125447) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:37:10.319686 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125447) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:37:10.382078 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-71f5f710-9d30-4e55-a409-e227b2fb315a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.586887 Oct 20 13:37:10.382924 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 96/187] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:37:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 13:37:10.402349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9dfb7c03-7b03-4c0e-ae4e-61ec4482efc0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:10.404945 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9dfb7c03-7b03-4c0e-ae4e-61ec4482efc0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:10.473901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9dfb7c03-7b03-4c0e-ae4e-61ec4482efc0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:10.485477 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9dfb7c03-7b03-4c0e-ae4e-61ec4482efc0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1222 microversion: 2.1 time: 0.093994 Oct 20 13:37:10.487561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 92/188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:10 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:11.510304 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e684c908-e915-4776-9734-1e7d8f3cce8f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:11.513424 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e684c908-e915-4776-9734-1e7d8f3cce8f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:11.525477 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e684c908-e915-4776-9734-1e7d8f3cce8f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:11.525973 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e684c908-e915-4776-9734-1e7d8f3cce8f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:11.526413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e684c908-e915-4776-9734-1e7d8f3cce8f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:11.527110 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e684c908-e915-4776-9734-1e7d8f3cce8f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:11.527561 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e684c908-e915-4776-9734-1e7d8f3cce8f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:11.527976 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e684c908-e915-4776-9734-1e7d8f3cce8f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:11.641172 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e684c908-e915-4776-9734-1e7d8f3cce8f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:11.652925 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e684c908-e915-4776-9734-1e7d8f3cce8f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1274 microversion: 2.1 time: 0.145260 Oct 20 13:37:11.654656 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 97/189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:11 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:12.680534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-55086046-9d7e-4c2f-b70a-ee29e39d3e84 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:12.693969 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-55086046-9d7e-4c2f-b70a-ee29e39d3e84 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:12.706090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55086046-9d7e-4c2f-b70a-ee29e39d3e84 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:12.707532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55086046-9d7e-4c2f-b70a-ee29e39d3e84 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:12.708233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55086046-9d7e-4c2f-b70a-ee29e39d3e84 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:12.709551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55086046-9d7e-4c2f-b70a-ee29e39d3e84 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:12.710614 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55086046-9d7e-4c2f-b70a-ee29e39d3e84 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:12.711347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55086046-9d7e-4c2f-b70a-ee29e39d3e84 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:12.883434 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-55086046-9d7e-4c2f-b70a-ee29e39d3e84 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:12.895433 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-55086046-9d7e-4c2f-b70a-ee29e39d3e84 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1280 microversion: 2.1 time: 0.219928 Oct 20 13:37:12.896517 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 93/190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:12 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:13.928272 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5f5018d1-c6f7-4c72-8968-014582e1ce23 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:13.930799 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5f5018d1-c6f7-4c72-8968-014582e1ce23 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:13.944143 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f5018d1-c6f7-4c72-8968-014582e1ce23 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:13.945383 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f5018d1-c6f7-4c72-8968-014582e1ce23 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:13.946449 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f5018d1-c6f7-4c72-8968-014582e1ce23 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:13.947991 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f5018d1-c6f7-4c72-8968-014582e1ce23 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:13.949505 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f5018d1-c6f7-4c72-8968-014582e1ce23 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:13.950834 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5f5018d1-c6f7-4c72-8968-014582e1ce23 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:14.193524 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5f5018d1-c6f7-4c72-8968-014582e1ce23 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:14.203962 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5f5018d1-c6f7-4c72-8968-014582e1ce23 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.283976 Oct 20 13:37:14.205481 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 98/191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:13 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:14.793665 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-ee97e72b-1163-483f-b2c2-e029ed28e00e req-041e626b-c10b-46b5-8b52-91c0b975d19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81af22d4-c2fa-4c17-9ab2-8cd63758321a", "tag": "ab34bd74-48bb-4f18-9a6f-ee06abb4b0e4"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:14.811564 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ee97e72b-1163-483f-b2c2-e029ed28e00e req-041e626b-c10b-46b5-8b52-91c0b975d19a service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:14.814479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ee97e72b-1163-483f-b2c2-e029ed28e00e req-041e626b-c10b-46b5-8b52-91c0b975d19a service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:14.817237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ee97e72b-1163-483f-b2c2-e029ed28e00e req-041e626b-c10b-46b5-8b52-91c0b975d19a service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:14.836643 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-ee97e72b-1163-483f-b2c2-e029ed28e00e req-041e626b-c10b-46b5-8b52-91c0b975d19a service nova] Creating event network-changed:ab34bd74-48bb-4f18-9a6f-ee06abb4b0e4 for instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a on hv-cinder-86213 Oct 20 13:37:14.843986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-ee97e72b-1163-483f-b2c2-e029ed28e00e req-041e626b-c10b-46b5-8b52-91c0b975d19a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053935 Oct 20 13:37:14.846649 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 94/192] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:15.227985 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-29bca6a8-a1b5-4604-a60c-46d338fea9ff tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:15.229190 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-29bca6a8-a1b5-4604-a60c-46d338fea9ff tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:15.239022 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29bca6a8-a1b5-4604-a60c-46d338fea9ff tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:15.239718 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29bca6a8-a1b5-4604-a60c-46d338fea9ff tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:15.240458 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29bca6a8-a1b5-4604-a60c-46d338fea9ff tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:15.241722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29bca6a8-a1b5-4604-a60c-46d338fea9ff tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:15.242189 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29bca6a8-a1b5-4604-a60c-46d338fea9ff tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:15.242620 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-29bca6a8-a1b5-4604-a60c-46d338fea9ff tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:15.427846 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-29bca6a8-a1b5-4604-a60c-46d338fea9ff tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:15.436151 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-29bca6a8-a1b5-4604-a60c-46d338fea9ff tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.212217 Oct 20 13:37:15.437329 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 99/193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:15 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:16.460578 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b1771916-f596-4cc7-8270-abde5a3c5210 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:16.461439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b1771916-f596-4cc7-8270-abde5a3c5210 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:16.477239 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1771916-f596-4cc7-8270-abde5a3c5210 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:16.477806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1771916-f596-4cc7-8270-abde5a3c5210 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:16.478317 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1771916-f596-4cc7-8270-abde5a3c5210 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:16.479088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1771916-f596-4cc7-8270-abde5a3c5210 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:16.479573 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1771916-f596-4cc7-8270-abde5a3c5210 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:16.480017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1771916-f596-4cc7-8270-abde5a3c5210 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:16.612181 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b1771916-f596-4cc7-8270-abde5a3c5210 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:16.619736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b1771916-f596-4cc7-8270-abde5a3c5210 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.163491 Oct 20 13:37:16.620297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 95/194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:16 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:16.637207 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-23a8a7e7-2ed1-4619-bc54-33f2668207ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:16.637741 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-23a8a7e7-2ed1-4619-bc54-33f2668207ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:16.644559 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-23a8a7e7-2ed1-4619-bc54-33f2668207ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:16.645069 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-23a8a7e7-2ed1-4619-bc54-33f2668207ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:16.645501 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-23a8a7e7-2ed1-4619-bc54-33f2668207ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:16.646180 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-23a8a7e7-2ed1-4619-bc54-33f2668207ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:16.646629 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-23a8a7e7-2ed1-4619-bc54-33f2668207ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:16.647044 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-23a8a7e7-2ed1-4619-bc54-33f2668207ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:16.670010 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-23a8a7e7-2ed1-4619-bc54-33f2668207ec tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/ips" status: 200 len: 145 microversion: 2.1 time: 0.036706 Oct 20 13:37:16.670565 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 100/195] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 20 13:37:16 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:16.874054 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-00620b3c-d77d-4eb4-b722-bb7c0bd76d2e req-127dbba5-3a81-444f-9854-b2c9a65b973f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979db05e-9dea-4267-9635-f5de10f841cb", "tag": "84925d54-d97f-47b3-ab29-4c56913ec155"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:16.883435 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-00620b3c-d77d-4eb4-b722-bb7c0bd76d2e req-127dbba5-3a81-444f-9854-b2c9a65b973f service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:16.883916 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-00620b3c-d77d-4eb4-b722-bb7c0bd76d2e req-127dbba5-3a81-444f-9854-b2c9a65b973f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:16.884341 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-00620b3c-d77d-4eb4-b722-bb7c0bd76d2e req-127dbba5-3a81-444f-9854-b2c9a65b973f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:16.895203 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-00620b3c-d77d-4eb4-b722-bb7c0bd76d2e req-127dbba5-3a81-444f-9854-b2c9a65b973f service nova] Creating event network-changed:84925d54-d97f-47b3-ab29-4c56913ec155 for instance 979db05e-9dea-4267-9635-f5de10f841cb on hv-cinder-86213 Oct 20 13:37:16.899776 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-00620b3c-d77d-4eb4-b722-bb7c0bd76d2e req-127dbba5-3a81-444f-9854-b2c9a65b973f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029423 Oct 20 13:37:16.900332 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 96/196] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:17.643326 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0fb7df86-6a34-4bc0-bad7-a9af77437684 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:17.643930 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0fb7df86-6a34-4bc0-bad7-a9af77437684 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:17.650267 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0fb7df86-6a34-4bc0-bad7-a9af77437684 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:17.650742 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0fb7df86-6a34-4bc0-bad7-a9af77437684 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:17.651165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0fb7df86-6a34-4bc0-bad7-a9af77437684 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:17.651873 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0fb7df86-6a34-4bc0-bad7-a9af77437684 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:17.652321 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0fb7df86-6a34-4bc0-bad7-a9af77437684 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:17.652736 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0fb7df86-6a34-4bc0-bad7-a9af77437684 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:17.782346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0fb7df86-6a34-4bc0-bad7-a9af77437684 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:17.791557 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0fb7df86-6a34-4bc0-bad7-a9af77437684 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.152730 Oct 20 13:37:17.792238 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 101/197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:17 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:18.814617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ac476dde-3522-422a-ac0c-4c1cbc40f23a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:18.815308 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ac476dde-3522-422a-ac0c-4c1cbc40f23a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:18.821396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac476dde-3522-422a-ac0c-4c1cbc40f23a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:18.821873 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac476dde-3522-422a-ac0c-4c1cbc40f23a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:18.822301 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac476dde-3522-422a-ac0c-4c1cbc40f23a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:18.823006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac476dde-3522-422a-ac0c-4c1cbc40f23a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:18.823453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac476dde-3522-422a-ac0c-4c1cbc40f23a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:18.823866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac476dde-3522-422a-ac0c-4c1cbc40f23a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:18.955740 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ac476dde-3522-422a-ac0c-4c1cbc40f23a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:18.963419 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ac476dde-3522-422a-ac0c-4c1cbc40f23a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.153113 Oct 20 13:37:18.963970 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 97/198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:18 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:19.987337 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e40061c4-6c3f-4ef7-b990-dcf913d93ddd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:19.988018 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e40061c4-6c3f-4ef7-b990-dcf913d93ddd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:19.994371 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e40061c4-6c3f-4ef7-b990-dcf913d93ddd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:19.994851 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e40061c4-6c3f-4ef7-b990-dcf913d93ddd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:19.995290 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e40061c4-6c3f-4ef7-b990-dcf913d93ddd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:19.995981 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e40061c4-6c3f-4ef7-b990-dcf913d93ddd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:19.996435 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e40061c4-6c3f-4ef7-b990-dcf913d93ddd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:19.996892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e40061c4-6c3f-4ef7-b990-dcf913d93ddd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:20.145677 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e40061c4-6c3f-4ef7-b990-dcf913d93ddd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:20.153777 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e40061c4-6c3f-4ef7-b990-dcf913d93ddd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.170697 Oct 20 13:37:20.154564 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 102/199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:19 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:20.202749 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-24bb6c74-4ac9-4142-9676-48ab83c46d88 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17329b13-e30e-4e90-b3d0-63b143df9262"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:20.209657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-24bb6c74-4ac9-4142-9676-48ab83c46d88 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:20.219299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-24bb6c74-4ac9-4142-9676-48ab83c46d88 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:20.220792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-24bb6c74-4ac9-4142-9676-48ab83c46d88 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:20.221348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-24bb6c74-4ac9-4142-9676-48ab83c46d88 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:20.222103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-24bb6c74-4ac9-4142-9676-48ab83c46d88 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:20.222702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-24bb6c74-4ac9-4142-9676-48ab83c46d88 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:20.223126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-24bb6c74-4ac9-4142-9676-48ab83c46d88 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:20.225332 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-51d06097-d24b-4c1a-afcd-8d742ffe2312 req-6954dc0f-036d-441d-9716-df46bef2487f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81af22d4-c2fa-4c17-9ab2-8cd63758321a", "name": "network-vif-plugged", "status": "completed", "tag": "ab34bd74-48bb-4f18-9a6f-ee06abb4b0e4"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:20.248381 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-51d06097-d24b-4c1a-afcd-8d742ffe2312 req-6954dc0f-036d-441d-9716-df46bef2487f service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:20.249157 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-51d06097-d24b-4c1a-afcd-8d742ffe2312 req-6954dc0f-036d-441d-9716-df46bef2487f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:20.250846 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-51d06097-d24b-4c1a-afcd-8d742ffe2312 req-6954dc0f-036d-441d-9716-df46bef2487f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:20.278437 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-51d06097-d24b-4c1a-afcd-8d742ffe2312 req-6954dc0f-036d-441d-9716-df46bef2487f service nova] Creating event network-vif-plugged:ab34bd74-48bb-4f18-9a6f-ee06abb4b0e4 for instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a on hv-cinder-86213 Oct 20 13:37:20.286603 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-51d06097-d24b-4c1a-afcd-8d742ffe2312 req-6954dc0f-036d-441d-9716-df46bef2487f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067204 Oct 20 13:37:20.287757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 103/200] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:37:20.478471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=4 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:20.600384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-4186ec92-e537-47a8-9d8c-f7104fb76f04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:20.601225 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-4186ec92-e537-47a8-9d8c-f7104fb76f04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:20.603294 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=4 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:20.604000 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=12 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:20.615250 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4186ec92-e537-47a8-9d8c-f7104fb76f04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:20.615762 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4186ec92-e537-47a8-9d8c-f7104fb76f04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:20.616278 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4186ec92-e537-47a8-9d8c-f7104fb76f04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:20.616895 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4186ec92-e537-47a8-9d8c-f7104fb76f04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:20.617342 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4186ec92-e537-47a8-9d8c-f7104fb76f04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:20.627858 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4186ec92-e537-47a8-9d8c-f7104fb76f04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:20.670205 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-4186ec92-e537-47a8-9d8c-f7104fb76f04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/ips" status: 200 len: 149 microversion: 2.1 time: 0.075698 Oct 20 13:37:20.670970 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 104/201] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 20 13:37:20 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/ips => generated 149 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:37:20.782662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-24bb6c74-4ac9-4142-9676-48ab83c46d88 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.600027 Oct 20 13:37:20.790303 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 98/202] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:37:20 2022] POST /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/os-volume_attachments => generated 194 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:21.189570 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-17acd9dd-dce7-46e4-9a39-ef1ffaee5fef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:21.190428 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-17acd9dd-dce7-46e4-9a39-ef1ffaee5fef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:21.199811 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-17acd9dd-dce7-46e4-9a39-ef1ffaee5fef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:21.200546 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-17acd9dd-dce7-46e4-9a39-ef1ffaee5fef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:21.201018 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-17acd9dd-dce7-46e4-9a39-ef1ffaee5fef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:21.201732 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-17acd9dd-dce7-46e4-9a39-ef1ffaee5fef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:21.202248 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-17acd9dd-dce7-46e4-9a39-ef1ffaee5fef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:21.202745 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-17acd9dd-dce7-46e4-9a39-ef1ffaee5fef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:21.354828 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-17acd9dd-dce7-46e4-9a39-ef1ffaee5fef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:21.363119 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-17acd9dd-dce7-46e4-9a39-ef1ffaee5fef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.183692 Oct 20 13:37:21.363798 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 105/203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:21 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:22.297539 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a2e66d4b-2c34-423a-8713-dfd732459c6b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27bafbc1-b045-4130-bcdd-1bfb2fbed327"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:22.301250 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a2e66d4b-2c34-423a-8713-dfd732459c6b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:22.310385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e66d4b-2c34-423a-8713-dfd732459c6b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:22.310863 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e66d4b-2c34-423a-8713-dfd732459c6b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:22.311289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e66d4b-2c34-423a-8713-dfd732459c6b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:22.312178 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e66d4b-2c34-423a-8713-dfd732459c6b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:22.312533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e66d4b-2c34-423a-8713-dfd732459c6b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:22.313014 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e66d4b-2c34-423a-8713-dfd732459c6b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:22.387317 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-740ca8d1-5003-4aea-9a85-744523f8a1b9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:22.388106 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-740ca8d1-5003-4aea-9a85-744523f8a1b9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:22.395785 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-740ca8d1-5003-4aea-9a85-744523f8a1b9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:22.396610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-740ca8d1-5003-4aea-9a85-744523f8a1b9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:22.397304 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-740ca8d1-5003-4aea-9a85-744523f8a1b9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:22.398101 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-740ca8d1-5003-4aea-9a85-744523f8a1b9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:22.398631 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-740ca8d1-5003-4aea-9a85-744523f8a1b9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:22.399130 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-740ca8d1-5003-4aea-9a85-744523f8a1b9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:22.548939 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-740ca8d1-5003-4aea-9a85-744523f8a1b9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:22.557742 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-740ca8d1-5003-4aea-9a85-744523f8a1b9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.175352 Oct 20 13:37:22.558386 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 106/204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:22 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:23.019320 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a2e66d4b-2c34-423a-8713-dfd732459c6b tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.727966 Oct 20 13:37:23.020147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 99/205] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:37:22 2022] POST /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:23.580595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-179be6f9-7dba-43e4-9905-be3228e35015 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:23.581899 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-179be6f9-7dba-43e4-9905-be3228e35015 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:23.592125 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-179be6f9-7dba-43e4-9905-be3228e35015 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:23.592524 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-179be6f9-7dba-43e4-9905-be3228e35015 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:23.593001 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-179be6f9-7dba-43e4-9905-be3228e35015 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:23.593725 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-179be6f9-7dba-43e4-9905-be3228e35015 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:23.594177 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-179be6f9-7dba-43e4-9905-be3228e35015 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:23.597304 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-179be6f9-7dba-43e4-9905-be3228e35015 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:23.738348 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-179be6f9-7dba-43e4-9905-be3228e35015 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:23.746181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-179be6f9-7dba-43e4-9905-be3228e35015 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.170370 Oct 20 13:37:23.746748 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 107/206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:23 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:24.217312 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-e1e45b52-2343-47a1-b5f1-24f54fcaae19 req-e0f57774-972b-4c38-bb66-141da6dd612a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979db05e-9dea-4267-9635-f5de10f841cb", "name": "network-vif-plugged", "status": "completed", "tag": "84925d54-d97f-47b3-ab29-4c56913ec155"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:24.230766 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-e1e45b52-2343-47a1-b5f1-24f54fcaae19 req-e0f57774-972b-4c38-bb66-141da6dd612a service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:24.231490 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-e1e45b52-2343-47a1-b5f1-24f54fcaae19 req-e0f57774-972b-4c38-bb66-141da6dd612a service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:24.232093 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-e1e45b52-2343-47a1-b5f1-24f54fcaae19 req-e0f57774-972b-4c38-bb66-141da6dd612a service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:24.244904 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-e1e45b52-2343-47a1-b5f1-24f54fcaae19 req-e0f57774-972b-4c38-bb66-141da6dd612a service nova] Creating event network-vif-plugged:84925d54-d97f-47b3-ab29-4c56913ec155 for instance 979db05e-9dea-4267-9635-f5de10f841cb on hv-cinder-86213 Oct 20 13:37:24.249690 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-e1e45b52-2343-47a1-b5f1-24f54fcaae19 req-e0f57774-972b-4c38-bb66-141da6dd612a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036959 Oct 20 13:37:24.250472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 100/207] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:24.770621 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3c60ce99-898a-4e2b-baf1-b3ba1e304465 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:24.771213 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3c60ce99-898a-4e2b-baf1-b3ba1e304465 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:24.778389 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c60ce99-898a-4e2b-baf1-b3ba1e304465 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:24.779254 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c60ce99-898a-4e2b-baf1-b3ba1e304465 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:24.779691 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c60ce99-898a-4e2b-baf1-b3ba1e304465 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:24.780508 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c60ce99-898a-4e2b-baf1-b3ba1e304465 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:24.781009 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c60ce99-898a-4e2b-baf1-b3ba1e304465 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:24.781573 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c60ce99-898a-4e2b-baf1-b3ba1e304465 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:24.914676 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3c60ce99-898a-4e2b-baf1-b3ba1e304465 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:24.922195 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3c60ce99-898a-4e2b-baf1-b3ba1e304465 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.157071 Oct 20 13:37:24.922823 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 108/208] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:24 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:25.946481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-06ac1671-ab59-48be-b186-7bf99e4a8267 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:25.947166 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-06ac1671-ab59-48be-b186-7bf99e4a8267 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:25.953241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06ac1671-ab59-48be-b186-7bf99e4a8267 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:25.953723 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06ac1671-ab59-48be-b186-7bf99e4a8267 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:25.954702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06ac1671-ab59-48be-b186-7bf99e4a8267 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:25.955374 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06ac1671-ab59-48be-b186-7bf99e4a8267 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:25.955825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06ac1671-ab59-48be-b186-7bf99e4a8267 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:25.956246 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06ac1671-ab59-48be-b186-7bf99e4a8267 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:26.089168 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-06ac1671-ab59-48be-b186-7bf99e4a8267 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:26.096754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-06ac1671-ab59-48be-b186-7bf99e4a8267 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1322 microversion: 2.1 time: 0.155044 Oct 20 13:37:26.097366 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 101/209] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:25 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:27.119587 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-ae67e3e2-288d-473e-8a5c-60638505e7a7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:27.120188 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-ae67e3e2-288d-473e-8a5c-60638505e7a7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:27.126825 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ae67e3e2-288d-473e-8a5c-60638505e7a7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:27.127309 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ae67e3e2-288d-473e-8a5c-60638505e7a7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:27.127737 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ae67e3e2-288d-473e-8a5c-60638505e7a7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:27.128418 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ae67e3e2-288d-473e-8a5c-60638505e7a7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:27.128881 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ae67e3e2-288d-473e-8a5c-60638505e7a7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:27.129297 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ae67e3e2-288d-473e-8a5c-60638505e7a7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:27.269819 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-ae67e3e2-288d-473e-8a5c-60638505e7a7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:27.293100 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-ae67e3e2-288d-473e-8a5c-60638505e7a7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1516 microversion: 2.1 time: 0.177253 Oct 20 13:37:27.293939 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 109/210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:27 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:27.315730 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d9f9892c-7e7d-456e-a3cb-9abaa7588467 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:27.318656 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d9f9892c-7e7d-456e-a3cb-9abaa7588467 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:27.325878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d9f9892c-7e7d-456e-a3cb-9abaa7588467 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:27.326571 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d9f9892c-7e7d-456e-a3cb-9abaa7588467 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:27.326849 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d9f9892c-7e7d-456e-a3cb-9abaa7588467 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:27.327799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d9f9892c-7e7d-456e-a3cb-9abaa7588467 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:27.328252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d9f9892c-7e7d-456e-a3cb-9abaa7588467 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:27.328673 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d9f9892c-7e7d-456e-a3cb-9abaa7588467 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:27.353462 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-d9f9892c-7e7d-456e-a3cb-9abaa7588467 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lazy-loading 'flavor' on Instance uuid 979db05e-9dea-4267-9635-f5de10f841cb {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:37:27.488811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d9f9892c-7e7d-456e-a3cb-9abaa7588467 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb/action" status: 200 len: 32 microversion: 2.1 time: 0.177058 Oct 20 13:37:27.490155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 102/211] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:37:27 2022] POST /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 13:37:27.515079 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d4376c4b-872d-4245-864e-6ffaf71a4115 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:27.515696 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d4376c4b-872d-4245-864e-6ffaf71a4115 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:27.523166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4376c4b-872d-4245-864e-6ffaf71a4115 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:27.524185 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4376c4b-872d-4245-864e-6ffaf71a4115 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:27.524972 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4376c4b-872d-4245-864e-6ffaf71a4115 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:27.526083 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4376c4b-872d-4245-864e-6ffaf71a4115 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:27.526676 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4376c4b-872d-4245-864e-6ffaf71a4115 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:27.528032 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d4376c4b-872d-4245-864e-6ffaf71a4115 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:27.717309 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d4376c4b-872d-4245-864e-6ffaf71a4115 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:27.726393 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d4376c4b-872d-4245-864e-6ffaf71a4115 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.230826 Oct 20 13:37:27.727110 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 110/212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:27 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:28.363940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2bf4ecb4-ecb4-4984-80ef-aa683ad03617 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:28.365500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2bf4ecb4-ecb4-4984-80ef-aa683ad03617 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:28.374793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2bf4ecb4-ecb4-4984-80ef-aa683ad03617 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:28.377055 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2bf4ecb4-ecb4-4984-80ef-aa683ad03617 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:28.377741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2bf4ecb4-ecb4-4984-80ef-aa683ad03617 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:28.378687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2bf4ecb4-ecb4-4984-80ef-aa683ad03617 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:28.379343 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2bf4ecb4-ecb4-4984-80ef-aa683ad03617 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:28.379980 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2bf4ecb4-ecb4-4984-80ef-aa683ad03617 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:28.412471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2bf4ecb4-ecb4-4984-80ef-aa683ad03617 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/ips" status: 200 len: 151 microversion: 2.20 time: 0.053567 Oct 20 13:37:28.413200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 103/213] 10.222.0.23 () {60 vars in 1289 bytes} [Thu Oct 20 13:37:28 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/ips => generated 151 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:37:28.718514 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5b9039ed-a600-4146-8021-40abc1be8078 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:28.727982 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b9039ed-a600-4146-8021-40abc1be8078 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:28.728840 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b9039ed-a600-4146-8021-40abc1be8078 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:28.729635 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b9039ed-a600-4146-8021-40abc1be8078 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:28.754680 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f61f55db-c6bd-44c8-8009-a859f44a3262 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:28.755299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f61f55db-c6bd-44c8-8009-a859f44a3262 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:28.765981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f61f55db-c6bd-44c8-8009-a859f44a3262 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:28.767337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f61f55db-c6bd-44c8-8009-a859f44a3262 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:28.768116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f61f55db-c6bd-44c8-8009-a859f44a3262 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:28.768853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f61f55db-c6bd-44c8-8009-a859f44a3262 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:28.769648 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f61f55db-c6bd-44c8-8009-a859f44a3262 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:28.770303 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f61f55db-c6bd-44c8-8009-a859f44a3262 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:28.816675 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5b9039ed-a600-4146-8021-40abc1be8078 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Going to try to stop instance {{(pid=125447) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 20 13:37:28.923929 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5b9039ed-a600-4146-8021-40abc1be8078 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/action" status: 202 len: 0 microversion: 2.1 time: 0.209566 Oct 20 13:37:28.941230 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 111/214] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:37:28 2022] POST /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:37:28.962835 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-312b5cfe-cb19-4240-a913-1bb7e2995658 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:28.964322 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-312b5cfe-cb19-4240-a913-1bb7e2995658 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:28.974933 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-312b5cfe-cb19-4240-a913-1bb7e2995658 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:28.975665 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-312b5cfe-cb19-4240-a913-1bb7e2995658 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:28.976193 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-312b5cfe-cb19-4240-a913-1bb7e2995658 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:28.977208 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-312b5cfe-cb19-4240-a913-1bb7e2995658 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:28.978046 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-312b5cfe-cb19-4240-a913-1bb7e2995658 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:28.978675 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-312b5cfe-cb19-4240-a913-1bb7e2995658 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:29.018328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f61f55db-c6bd-44c8-8009-a859f44a3262 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:29.026565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f61f55db-c6bd-44c8-8009-a859f44a3262 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.277863 Oct 20 13:37:29.027223 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 104/215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:28 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:29.301480 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-312b5cfe-cb19-4240-a913-1bb7e2995658 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:29.313758 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-312b5cfe-cb19-4240-a913-1bb7e2995658 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.366157 Oct 20 13:37:29.314633 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 112/216] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:28 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:30.053880 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-09ecdf65-36b7-48e6-848e-9b0ecd2adecf tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:30.056676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-09ecdf65-36b7-48e6-848e-9b0ecd2adecf tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:30.063287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09ecdf65-36b7-48e6-848e-9b0ecd2adecf tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:30.063769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09ecdf65-36b7-48e6-848e-9b0ecd2adecf tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:30.064197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09ecdf65-36b7-48e6-848e-9b0ecd2adecf tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:30.064920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09ecdf65-36b7-48e6-848e-9b0ecd2adecf tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:30.065366 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09ecdf65-36b7-48e6-848e-9b0ecd2adecf tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:30.065963 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09ecdf65-36b7-48e6-848e-9b0ecd2adecf tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:30.221606 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-09ecdf65-36b7-48e6-848e-9b0ecd2adecf tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:30.230149 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-09ecdf65-36b7-48e6-848e-9b0ecd2adecf tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.180477 Oct 20 13:37:30.230823 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 105/217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:30 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:30.342049 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-32870e43-7ef4-4bcd-9969-c3ffc8d0d555 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:30.342889 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-32870e43-7ef4-4bcd-9969-c3ffc8d0d555 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:30.351014 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32870e43-7ef4-4bcd-9969-c3ffc8d0d555 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:30.351682 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32870e43-7ef4-4bcd-9969-c3ffc8d0d555 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:30.352431 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32870e43-7ef4-4bcd-9969-c3ffc8d0d555 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:30.353323 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32870e43-7ef4-4bcd-9969-c3ffc8d0d555 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:30.354061 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32870e43-7ef4-4bcd-9969-c3ffc8d0d555 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:30.354674 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-32870e43-7ef4-4bcd-9969-c3ffc8d0d555 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:30.362787 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:30.544105 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-32870e43-7ef4-4bcd-9969-c3ffc8d0d555 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:30.554636 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-32870e43-7ef4-4bcd-9969-c3ffc8d0d555 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.217876 Oct 20 13:37:30.555480 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 113/218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:30 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:31.237993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-903ac45c-3b14-4005-ba2c-6984acd7feec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:31.239116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-903ac45c-3b14-4005-ba2c-6984acd7feec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:31.246262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-903ac45c-3b14-4005-ba2c-6984acd7feec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:31.248375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-903ac45c-3b14-4005-ba2c-6984acd7feec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:31.248375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-903ac45c-3b14-4005-ba2c-6984acd7feec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:31.248375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-903ac45c-3b14-4005-ba2c-6984acd7feec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:31.248684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-903ac45c-3b14-4005-ba2c-6984acd7feec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:31.249262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-903ac45c-3b14-4005-ba2c-6984acd7feec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:31.256596 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-8c462d14-2f49-4fc9-96c8-2e3df13335e0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:31.257232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-8c462d14-2f49-4fc9-96c8-2e3df13335e0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:31.263754 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8c462d14-2f49-4fc9-96c8-2e3df13335e0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:31.264227 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8c462d14-2f49-4fc9-96c8-2e3df13335e0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:31.264710 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8c462d14-2f49-4fc9-96c8-2e3df13335e0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:31.265464 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8c462d14-2f49-4fc9-96c8-2e3df13335e0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:31.265917 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8c462d14-2f49-4fc9-96c8-2e3df13335e0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:31.266998 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8c462d14-2f49-4fc9-96c8-2e3df13335e0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:31.278453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-903ac45c-3b14-4005-ba2c-6984acd7feec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lazy-loading 'flavor' on Instance uuid 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:37:31.305752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:31.486582 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-8c462d14-2f49-4fc9-96c8-2e3df13335e0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:31.496367 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-8c462d14-2f49-4fc9-96c8-2e3df13335e0 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.244725 Oct 20 13:37:31.497237 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 114/219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:31 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:31.580066 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6ab18adf-03fe-484b-b805-54e9bab7ae0a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:31.581224 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-6ab18adf-03fe-484b-b805-54e9bab7ae0a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:31.593253 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ab18adf-03fe-484b-b805-54e9bab7ae0a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:31.594104 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ab18adf-03fe-484b-b805-54e9bab7ae0a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:31.595388 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ab18adf-03fe-484b-b805-54e9bab7ae0a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:31.597339 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ab18adf-03fe-484b-b805-54e9bab7ae0a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:31.598089 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ab18adf-03fe-484b-b805-54e9bab7ae0a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:31.598659 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ab18adf-03fe-484b-b805-54e9bab7ae0a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:31.628904 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-903ac45c-3b14-4005-ba2c-6984acd7feec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "POST /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/action" status: 202 len: 0 microversion: 2.20 time: 0.395728 Oct 20 13:37:31.631161 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 106/220] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 20 13:37:31 2022] POST /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:37:31.640959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:31.642920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:31.651483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:31.652850 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:31.653557 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:31.654642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:31.655461 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:31.656199 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:31.930594 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:31.946304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:31.948191 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:31.950644 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-56cb46e4-6449-4486-8a4c-6c025be72f1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.314634 Oct 20 13:37:31.952779 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 107/221] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:31 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:31.962708 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-6ab18adf-03fe-484b-b805-54e9bab7ae0a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:31.972499 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-6ab18adf-03fe-484b-b805-54e9bab7ae0a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.396745 Oct 20 13:37:31.973294 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 115/222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:31 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:32.527719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-99760c90-7e7d-4c30-afce-67e2caf9b648 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:32.528405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-99760c90-7e7d-4c30-afce-67e2caf9b648 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:32.535475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-99760c90-7e7d-4c30-afce-67e2caf9b648 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:32.535955 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-99760c90-7e7d-4c30-afce-67e2caf9b648 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:32.536381 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-99760c90-7e7d-4c30-afce-67e2caf9b648 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:32.537097 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-99760c90-7e7d-4c30-afce-67e2caf9b648 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:32.537538 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-99760c90-7e7d-4c30-afce-67e2caf9b648 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:32.537951 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-99760c90-7e7d-4c30-afce-67e2caf9b648 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:32.696333 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-99760c90-7e7d-4c30-afce-67e2caf9b648 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:32.704697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-99760c90-7e7d-4c30-afce-67e2caf9b648 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.182234 Oct 20 13:37:32.705483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 108/223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:32 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:32.986199 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:32.987325 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:32.994181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:32.994729 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:32.995172 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:32.995893 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:32.996316 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:32.996750 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:32.997892 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-878a11d3-bd96-48cd-9c54-4abd949f2cd3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:32.998539 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-878a11d3-bd96-48cd-9c54-4abd949f2cd3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:33.006396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-878a11d3-bd96-48cd-9c54-4abd949f2cd3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:33.006809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-878a11d3-bd96-48cd-9c54-4abd949f2cd3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:33.007382 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-878a11d3-bd96-48cd-9c54-4abd949f2cd3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:33.008073 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-878a11d3-bd96-48cd-9c54-4abd949f2cd3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:33.008686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-878a11d3-bd96-48cd-9c54-4abd949f2cd3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:33.015525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-878a11d3-bd96-48cd-9c54-4abd949f2cd3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:33.153737 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:33.166513 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:33.168743 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:33.170774 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-177944f0-34a0-45b5-b419-46009ae52d30 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.191463 Oct 20 13:37:33.171531 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 116/224] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:32 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:33.239544 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-878a11d3-bd96-48cd-9c54-4abd949f2cd3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:33.259874 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-878a11d3-bd96-48cd-9c54-4abd949f2cd3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.265991 Oct 20 13:37:33.261260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 109/225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:32 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:33.728709 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5bc38398-19ea-4057-a14d-87a7a8d8cd0e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:33.730223 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5bc38398-19ea-4057-a14d-87a7a8d8cd0e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:33.738019 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5bc38398-19ea-4057-a14d-87a7a8d8cd0e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:33.740728 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5bc38398-19ea-4057-a14d-87a7a8d8cd0e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:33.743286 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5bc38398-19ea-4057-a14d-87a7a8d8cd0e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:33.746029 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5bc38398-19ea-4057-a14d-87a7a8d8cd0e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:33.747006 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5bc38398-19ea-4057-a14d-87a7a8d8cd0e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:33.747613 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5bc38398-19ea-4057-a14d-87a7a8d8cd0e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:33.991614 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5bc38398-19ea-4057-a14d-87a7a8d8cd0e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:34.002332 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5bc38398-19ea-4057-a14d-87a7a8d8cd0e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.278119 Oct 20 13:37:34.003156 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 117/226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:33 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:34.197585 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:34.199638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:34.207413 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:34.212732 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:34.213321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:34.214126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:34.214643 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:34.215127 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:34.287509 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3c06681d-eab2-4070-a54f-c10e26681f66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:34.288761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3c06681d-eab2-4070-a54f-c10e26681f66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:34.295614 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c06681d-eab2-4070-a54f-c10e26681f66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:34.296513 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c06681d-eab2-4070-a54f-c10e26681f66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:34.297340 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c06681d-eab2-4070-a54f-c10e26681f66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:34.298265 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c06681d-eab2-4070-a54f-c10e26681f66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:34.298931 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c06681d-eab2-4070-a54f-c10e26681f66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:34.299548 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c06681d-eab2-4070-a54f-c10e26681f66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:34.405754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:34.435513 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:34.441560 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:34.442782 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1769992d-7e62-4f69-98a1-9f90cb35b4c6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.249162 Oct 20 13:37:34.443339 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 110/227] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:34 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:34.581668 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3c06681d-eab2-4070-a54f-c10e26681f66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:34.591543 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3c06681d-eab2-4070-a54f-c10e26681f66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.310397 Oct 20 13:37:34.592658 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 118/228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:34 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:35.027914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-67931466-6fc2-46bb-9ece-a1f3fa283d3b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:35.028521 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-67931466-6fc2-46bb-9ece-a1f3fa283d3b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:35.043839 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67931466-6fc2-46bb-9ece-a1f3fa283d3b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:35.044987 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67931466-6fc2-46bb-9ece-a1f3fa283d3b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:35.045624 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67931466-6fc2-46bb-9ece-a1f3fa283d3b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:35.046550 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67931466-6fc2-46bb-9ece-a1f3fa283d3b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:35.047245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67931466-6fc2-46bb-9ece-a1f3fa283d3b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:35.047908 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67931466-6fc2-46bb-9ece-a1f3fa283d3b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:35.058344 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e6f154f3-d7dd-4463-8b43-e684b07e27e1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: .version_select at 0x7ffa12e953a0>, body: {"keypair": {"name": "tempest-keypair-741114834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAacMMFa455m0i+TsJWwpqvc+qNix6rBIL+HGCXZU75CAfydN+EP5EKAOUUIP4mUsrRb5j5AaBbrbozFIsIDcu4V2BbAzGyZKdgJ5WSmXKxTCguYTqOwBhKz3h6M8Y8APQ=="}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:35.091702 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-e6f154f3-d7dd-4463-8b43-e684b07e27e1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for project b215cb88123a4851932dbf7dfa88f709. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:37:35.104132 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-e6f154f3-d7dd-4463-8b43-e684b07e27e1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for user 144e9801ac1f470083d11647652ccdf1 and project b215cb88123a4851932dbf7dfa88f709. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:37:35.149530 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e6f154f3-d7dd-4463-8b43-e684b07e27e1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097103 Oct 20 13:37:35.150334 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 119/229] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 20 13:37:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:37:35.253894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-67931466-6fc2-46bb-9ece-a1f3fa283d3b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:35.265106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-67931466-6fc2-46bb-9ece-a1f3fa283d3b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.240616 Oct 20 13:37:35.266284 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 111/230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:35 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:35.467886 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:35.468724 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:35.482444 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:35.483302 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:35.484054 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:35.488072 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:35.488651 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:35.489216 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:35.616094 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8785f7a9-99ed-4294-bfce-a0f49856a142 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:35.617026 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8785f7a9-99ed-4294-bfce-a0f49856a142 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:35.635576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8785f7a9-99ed-4294-bfce-a0f49856a142 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:35.636332 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8785f7a9-99ed-4294-bfce-a0f49856a142 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:35.636772 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8785f7a9-99ed-4294-bfce-a0f49856a142 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:35.639436 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8785f7a9-99ed-4294-bfce-a0f49856a142 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:35.640121 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8785f7a9-99ed-4294-bfce-a0f49856a142 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:35.641313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8785f7a9-99ed-4294-bfce-a0f49856a142 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:35.924714 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8785f7a9-99ed-4294-bfce-a0f49856a142 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:35.936595 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8785f7a9-99ed-4294-bfce-a0f49856a142 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.324578 Oct 20 13:37:35.938420 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 112/231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:35 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:36.000733 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:36.012056 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:36.014272 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:36.022354 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a4eb3e50-445b-41c2-906a-99ccd0aea481 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.557064 Oct 20 13:37:36.023437 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 120/232] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:35 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:36.297634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7d661cdb-bfff-41de-a353-1f257b44afc1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:36.298426 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7d661cdb-bfff-41de-a353-1f257b44afc1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:36.312023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d661cdb-bfff-41de-a353-1f257b44afc1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:36.313456 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d661cdb-bfff-41de-a353-1f257b44afc1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:36.314620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d661cdb-bfff-41de-a353-1f257b44afc1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:36.315679 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d661cdb-bfff-41de-a353-1f257b44afc1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:36.316291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d661cdb-bfff-41de-a353-1f257b44afc1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:36.317116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d661cdb-bfff-41de-a353-1f257b44afc1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:36.550153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7d661cdb-bfff-41de-a353-1f257b44afc1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:36.561680 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7d661cdb-bfff-41de-a353-1f257b44afc1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.275412 Oct 20 13:37:36.563664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 113/233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:36 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:36.965211 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-73077b17-29b2-4e27-83cc-d0ea945e4196 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:36.966464 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-73077b17-29b2-4e27-83cc-d0ea945e4196 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:36.975449 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73077b17-29b2-4e27-83cc-d0ea945e4196 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:36.976813 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73077b17-29b2-4e27-83cc-d0ea945e4196 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:36.977634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73077b17-29b2-4e27-83cc-d0ea945e4196 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:36.979180 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73077b17-29b2-4e27-83cc-d0ea945e4196 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:36.980824 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73077b17-29b2-4e27-83cc-d0ea945e4196 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:36.981716 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-73077b17-29b2-4e27-83cc-d0ea945e4196 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:37.051377 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:37.052223 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:37.058515 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:37.059202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:37.059781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:37.060692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:37.061314 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:37.061900 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:37.307743 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-73077b17-29b2-4e27-83cc-d0ea945e4196 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:37.320771 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-73077b17-29b2-4e27-83cc-d0ea945e4196 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.357736 Oct 20 13:37:37.332709 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 121/234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:36 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:37.552840 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:37.563714 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:37.567148 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:37.569509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-de7b746d-6483-4b75-9649-de572738e61f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.523855 Oct 20 13:37:37.572768 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 114/235] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:37 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:37.587843 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-2e55d924-1e0c-44fb-a4ae-b3d23a142bb7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:37.588455 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-2e55d924-1e0c-44fb-a4ae-b3d23a142bb7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:37.600966 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2e55d924-1e0c-44fb-a4ae-b3d23a142bb7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:37.602404 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2e55d924-1e0c-44fb-a4ae-b3d23a142bb7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:37.603051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2e55d924-1e0c-44fb-a4ae-b3d23a142bb7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:37.603975 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2e55d924-1e0c-44fb-a4ae-b3d23a142bb7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:37.605016 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2e55d924-1e0c-44fb-a4ae-b3d23a142bb7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:37.605636 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2e55d924-1e0c-44fb-a4ae-b3d23a142bb7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:37.891656 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-2e55d924-1e0c-44fb-a4ae-b3d23a142bb7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:37.901869 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-2e55d924-1e0c-44fb-a4ae-b3d23a142bb7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.317914 Oct 20 13:37:37.913628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 122/236] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:37 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:38.360475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8a626d26-0e97-4264-a3ab-b7ec2f8259f3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:38.361125 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8a626d26-0e97-4264-a3ab-b7ec2f8259f3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:38.367775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8a626d26-0e97-4264-a3ab-b7ec2f8259f3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:38.368472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8a626d26-0e97-4264-a3ab-b7ec2f8259f3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:38.369144 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8a626d26-0e97-4264-a3ab-b7ec2f8259f3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:38.370046 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8a626d26-0e97-4264-a3ab-b7ec2f8259f3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:38.370692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8a626d26-0e97-4264-a3ab-b7ec2f8259f3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:38.371331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8a626d26-0e97-4264-a3ab-b7ec2f8259f3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:38.586262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8a626d26-0e97-4264-a3ab-b7ec2f8259f3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:38.600787 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:38.601500 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:38.602357 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8a626d26-0e97-4264-a3ab-b7ec2f8259f3 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.244979 Oct 20 13:37:38.603418 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 115/237] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:38 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:38.630040 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:38.630888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:38.634491 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:38.635436 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:38.637498 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:38.638231 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:38.792293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1837140868", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a87efad-1518-4319-8b6e-3edd28303f86"}], "security_groups": [{"name": "tempest-securitygroup--1413428764"}], "key_name": "tempest-keypair-741114834", "user_data": "}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:38.894331 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:38.919332 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:38.923529 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:38.927460 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-68e07851-7a67-4006-90b4-1b8c63707f03 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.330970 Oct 20 13:37:38.929671 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 123/238] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:38 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:38.935096 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b331fe58-c9e4-42b1-a25b-cbdba70bb5e3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:38.935900 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b331fe58-c9e4-42b1-a25b-cbdba70bb5e3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:38.938602 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:38.944472 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b331fe58-c9e4-42b1-a25b-cbdba70bb5e3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:38.945123 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b331fe58-c9e4-42b1-a25b-cbdba70bb5e3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:38.945634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b331fe58-c9e4-42b1-a25b-cbdba70bb5e3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:38.947198 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b331fe58-c9e4-42b1-a25b-cbdba70bb5e3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:38.947858 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b331fe58-c9e4-42b1-a25b-cbdba70bb5e3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:38.951381 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b331fe58-c9e4-42b1-a25b-cbdba70bb5e3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:38.975499 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.network.neutron [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] validate_networks() for [('6a87efad-1518-4319-8b6e-3edd28303f86', None, None, None, None, None)] {{(pid=125448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:37:39.230967 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b331fe58-c9e4-42b1-a25b-cbdba70bb5e3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:39.239818 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b331fe58-c9e4-42b1-a25b-cbdba70bb5e3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.308557 Oct 20 13:37:39.240388 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 124/239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:38 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:39.447150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Flavor limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:37:39.447562 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Image limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:37:39.448246 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Flavor pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:37:39.448803 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Image pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:37:39.449377 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:37:39.460182 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:39.460897 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:39.461475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:39.462356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:39.462985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:39.463554 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:39.520598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for project b215cb88123a4851932dbf7dfa88f709. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:37:39.536032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for user 144e9801ac1f470083d11647652ccdf1 and project b215cb88123a4851932dbf7dfa88f709. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:37:39.553620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Going to run 1 instances... {{(pid=125448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:37:39.556212 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:37:39.646771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-50119a22-3bf7-4387-b783-75cf85106c45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.854167 Oct 20 13:37:39.647488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 116/240] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:37:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 13:37:39.655674 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a57813e2-eab1-4754-9fa3-add781133b19 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:39.657550 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a57813e2-eab1-4754-9fa3-add781133b19 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:39.659286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e322dc99-3ff7-4050-be09-fb4225ceafab tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:39.659993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e322dc99-3ff7-4050-be09-fb4225ceafab tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:39.674006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:39.696301 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a57813e2-eab1-4754-9fa3-add781133b19 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:39.696904 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a57813e2-eab1-4754-9fa3-add781133b19 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:39.697619 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a57813e2-eab1-4754-9fa3-add781133b19 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:39.698498 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a57813e2-eab1-4754-9fa3-add781133b19 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:39.699130 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a57813e2-eab1-4754-9fa3-add781133b19 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:39.699801 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a57813e2-eab1-4754-9fa3-add781133b19 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:39.866843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e322dc99-3ff7-4050-be09-fb4225ceafab tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:39.883229 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e322dc99-3ff7-4050-be09-fb4225ceafab tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1241 microversion: 2.1 time: 0.226387 Oct 20 13:37:39.885312 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 117/241] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:39 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1241 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:39.959098 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:39.959789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:39.979294 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a57813e2-eab1-4754-9fa3-add781133b19 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:39.990017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:39.992775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:39.995510 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:39.996947 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:39.999482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:40.000566 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:40.029038 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a57813e2-eab1-4754-9fa3-add781133b19 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.398648 Oct 20 13:37:40.029676 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 125/242] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:39 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:40.302086 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:40.310600 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:40.312306 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:40.314342 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-84c3e03f-633f-424a-8f88-23af63fb35f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.361689 Oct 20 13:37:40.315021 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 118/243] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:39 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:37:40.319878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-004df290-16be-4783-9763-1b0dff647036 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:40.320490 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-004df290-16be-4783-9763-1b0dff647036 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:40.342580 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-004df290-16be-4783-9763-1b0dff647036 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:40.343343 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-004df290-16be-4783-9763-1b0dff647036 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:40.346268 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-004df290-16be-4783-9763-1b0dff647036 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:40.347470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-004df290-16be-4783-9763-1b0dff647036 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:40.348588 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-004df290-16be-4783-9763-1b0dff647036 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:40.349211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-004df290-16be-4783-9763-1b0dff647036 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:40.398040 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-801fcbcf-92ba-4eb3-a8ee-ae5f3d850199 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Action: 'create', calling method: .version_select at 0x7ffa1302d820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1334420547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY+5L6oj5BOCxOihbCAkRTvEUsCwZUPGfo4BZT5RbWAyCnRf4fbSoM0w80nkoA5zcle304AgH7jzhSTHrZ1A2ppmn/rO+ApQeCMtDeduPqqamyy6I7iJdnN/CswYvlQBg=="}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:40.415146 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-801fcbcf-92ba-4eb3-a8ee-ae5f3d850199 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Getting quotas for project 32ef0737a3844bfe8f4bc14b09ebc88b. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:37:40.418992 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-801fcbcf-92ba-4eb3-a8ee-ae5f3d850199 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Getting quotas for user c9ac26a28e7b416b9786ddcacea5928e and project 32ef0737a3844bfe8f4bc14b09ebc88b. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:37:40.446384 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-801fcbcf-92ba-4eb3-a8ee-ae5f3d850199 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.286609 Oct 20 13:37:40.446993 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 126/244] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 20 13:37:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:40.667189 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-004df290-16be-4783-9763-1b0dff647036 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:40.676014 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-004df290-16be-4783-9763-1b0dff647036 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.359642 Oct 20 13:37:40.676798 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 119/245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:40 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:40.908418 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-91b3150a-6026-4a71-ae68-b392938a4f1a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:40.909131 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-91b3150a-6026-4a71-ae68-b392938a4f1a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:40.919424 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-91b3150a-6026-4a71-ae68-b392938a4f1a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:40.922538 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-91b3150a-6026-4a71-ae68-b392938a4f1a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:40.922997 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-91b3150a-6026-4a71-ae68-b392938a4f1a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:40.923722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-91b3150a-6026-4a71-ae68-b392938a4f1a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:40.924187 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-91b3150a-6026-4a71-ae68-b392938a4f1a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:40.924621 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-91b3150a-6026-4a71-ae68-b392938a4f1a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:41.019407 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-91b3150a-6026-4a71-ae68-b392938a4f1a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:41.030514 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-91b3150a-6026-4a71-ae68-b392938a4f1a tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1293 microversion: 2.1 time: 0.127935 Oct 20 13:37:41.038166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 127/246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:40 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1293 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:41.056076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b2bfd939-6c27-4c0d-bca7-202827f9e6e7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:41.056768 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b2bfd939-6c27-4c0d-bca7-202827f9e6e7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:41.064290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2bfd939-6c27-4c0d-bca7-202827f9e6e7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:41.065098 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2bfd939-6c27-4c0d-bca7-202827f9e6e7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:41.065958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2bfd939-6c27-4c0d-bca7-202827f9e6e7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:41.066747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2bfd939-6c27-4c0d-bca7-202827f9e6e7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:41.067306 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2bfd939-6c27-4c0d-bca7-202827f9e6e7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:41.068076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2bfd939-6c27-4c0d-bca7-202827f9e6e7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:41.276212 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b2bfd939-6c27-4c0d-bca7-202827f9e6e7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:41.285743 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b2bfd939-6c27-4c0d-bca7-202827f9e6e7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.233470 Oct 20 13:37:41.286536 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 120/247] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:41 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:41.343521 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:41.345025 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:41.354354 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:41.361545 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:41.361997 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:41.363039 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:41.363647 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:41.364219 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:41.575240 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:41.592270 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:41.598245 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:41.609506 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-cf749b62-f1df-43b4-9ac1-9cf88fc8b0d0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.270519 Oct 20 13:37:41.610716 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 128/248] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:41 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:41.701802 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d002d6a0-1678-4eb9-a098-7caa9829faef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:41.702481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d002d6a0-1678-4eb9-a098-7caa9829faef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:41.717011 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d002d6a0-1678-4eb9-a098-7caa9829faef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:41.719642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d002d6a0-1678-4eb9-a098-7caa9829faef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:41.720144 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d002d6a0-1678-4eb9-a098-7caa9829faef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:41.720926 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d002d6a0-1678-4eb9-a098-7caa9829faef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:41.724986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d002d6a0-1678-4eb9-a098-7caa9829faef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:41.725457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d002d6a0-1678-4eb9-a098-7caa9829faef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:42.057471 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f30ca8e3-fcea-4c3b-88aa-52299f9e9e4f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:42.058137 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-f30ca8e3-fcea-4c3b-88aa-52299f9e9e4f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:42.067902 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f30ca8e3-fcea-4c3b-88aa-52299f9e9e4f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:42.069011 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f30ca8e3-fcea-4c3b-88aa-52299f9e9e4f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:42.071834 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f30ca8e3-fcea-4c3b-88aa-52299f9e9e4f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:42.072605 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f30ca8e3-fcea-4c3b-88aa-52299f9e9e4f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:42.073156 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f30ca8e3-fcea-4c3b-88aa-52299f9e9e4f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:42.074210 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f30ca8e3-fcea-4c3b-88aa-52299f9e9e4f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:42.085335 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d002d6a0-1678-4eb9-a098-7caa9829faef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:42.094723 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d002d6a0-1678-4eb9-a098-7caa9829faef tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.398678 Oct 20 13:37:42.099914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 121/249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:41 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:42.190627 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-f30ca8e3-fcea-4c3b-88aa-52299f9e9e4f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:42.215055 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-f30ca8e3-fcea-4c3b-88aa-52299f9e9e4f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1299 microversion: 2.1 time: 0.162528 Oct 20 13:37:42.229050 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 129/250] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:42 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:42.312275 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-05175934-363b-40d7-976c-5fccc9ecad21 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:42.313400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-05175934-363b-40d7-976c-5fccc9ecad21 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:42.322862 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05175934-363b-40d7-976c-5fccc9ecad21 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:42.323354 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05175934-363b-40d7-976c-5fccc9ecad21 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:42.323829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05175934-363b-40d7-976c-5fccc9ecad21 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:42.324599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05175934-363b-40d7-976c-5fccc9ecad21 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:42.329659 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05175934-363b-40d7-976c-5fccc9ecad21 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:42.333209 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05175934-363b-40d7-976c-5fccc9ecad21 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:42.644291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:42.645990 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:42.656505 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:42.659232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:42.659925 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:42.661894 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:42.663277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:42.663906 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:42.686704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-05175934-363b-40d7-976c-5fccc9ecad21 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:42.695838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-05175934-363b-40d7-976c-5fccc9ecad21 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.388564 Oct 20 13:37:42.700017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 122/251] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:42 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:42.983510 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:42.993949 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:42.996086 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:43.000624 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-38b53de4-fb54-47df-90be-cc229fe04b25 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.364616 Oct 20 13:37:43.005310 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 130/252] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:42 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:43.135551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8ce9ff00-47b1-48bd-b614-437ca9f03aa2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:43.137638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8ce9ff00-47b1-48bd-b614-437ca9f03aa2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:43.160381 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ce9ff00-47b1-48bd-b614-437ca9f03aa2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:43.161258 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ce9ff00-47b1-48bd-b614-437ca9f03aa2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:43.162084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ce9ff00-47b1-48bd-b614-437ca9f03aa2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:43.165066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ce9ff00-47b1-48bd-b614-437ca9f03aa2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:43.166600 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ce9ff00-47b1-48bd-b614-437ca9f03aa2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:43.167241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ce9ff00-47b1-48bd-b614-437ca9f03aa2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:43.201563 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:43.242202 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-35e39a3b-865d-410f-984f-c4fb29757c58 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:43.242972 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-35e39a3b-865d-410f-984f-c4fb29757c58 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:43.251989 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35e39a3b-865d-410f-984f-c4fb29757c58 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:43.252732 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35e39a3b-865d-410f-984f-c4fb29757c58 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:43.253421 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35e39a3b-865d-410f-984f-c4fb29757c58 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:43.254316 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35e39a3b-865d-410f-984f-c4fb29757c58 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:43.255021 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35e39a3b-865d-410f-984f-c4fb29757c58 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:43.260179 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35e39a3b-865d-410f-984f-c4fb29757c58 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:43.567896 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-35e39a3b-865d-410f-984f-c4fb29757c58 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:43.572368 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=100 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:43.577531 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-35e39a3b-865d-410f-984f-c4fb29757c58 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1367 microversion: 2.1 time: 0.339879 Oct 20 13:37:43.580030 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 131/253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:43 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:43.660133 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8ce9ff00-47b1-48bd-b614-437ca9f03aa2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:43.668857 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8ce9ff00-47b1-48bd-b614-437ca9f03aa2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.550034 Oct 20 13:37:43.670914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 123/254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:43 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:43.720586 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5b34d0c7-d311-45a5-ad4e-ff4700214c17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:43.721505 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5b34d0c7-d311-45a5-ad4e-ff4700214c17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:43.730362 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b34d0c7-d311-45a5-ad4e-ff4700214c17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:43.736034 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b34d0c7-d311-45a5-ad4e-ff4700214c17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:43.736747 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b34d0c7-d311-45a5-ad4e-ff4700214c17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:43.737948 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b34d0c7-d311-45a5-ad4e-ff4700214c17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:43.738623 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b34d0c7-d311-45a5-ad4e-ff4700214c17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:43.739146 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5b34d0c7-d311-45a5-ad4e-ff4700214c17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:43.925383 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5b34d0c7-d311-45a5-ad4e-ff4700214c17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:43.940339 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5b34d0c7-d311-45a5-ad4e-ff4700214c17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1722 microversion: 2.1 time: 0.224702 Oct 20 13:37:43.941548 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 132/255] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:43 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:44.029048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:44.030500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:44.039764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:44.040549 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:44.041011 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:44.041924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:44.042500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:44.042918 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:44.349616 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:44.366157 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:44.372994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:44.375432 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1a96726e-c32d-4ec6-a467-97a105f330d8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.350708 Oct 20 13:37:44.376610 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 124/256] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:44 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:44.581242 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-edd3b136-0a8c-4844-ac63-457b8690b29a req-4cfc0d96-7155-417d-a284-ca55e738f2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4fc63ee-55ed-437c-81f4-4d658bf32051", "tag": "bdeef6a2-1b0c-458c-adee-98e42b80b14c"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:44.603747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d638f5f5-271d-461d-9c1f-d7c9b76bc1bb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:44.604636 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d638f5f5-271d-461d-9c1f-d7c9b76bc1bb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:44.612099 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-edd3b136-0a8c-4844-ac63-457b8690b29a req-4cfc0d96-7155-417d-a284-ca55e738f2f7 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:44.612810 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-edd3b136-0a8c-4844-ac63-457b8690b29a req-4cfc0d96-7155-417d-a284-ca55e738f2f7 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:44.613529 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-edd3b136-0a8c-4844-ac63-457b8690b29a req-4cfc0d96-7155-417d-a284-ca55e738f2f7 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:44.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d638f5f5-271d-461d-9c1f-d7c9b76bc1bb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:44.627703 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d638f5f5-271d-461d-9c1f-d7c9b76bc1bb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:44.632162 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d638f5f5-271d-461d-9c1f-d7c9b76bc1bb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:44.633458 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d638f5f5-271d-461d-9c1f-d7c9b76bc1bb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:44.633776 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-edd3b136-0a8c-4844-ac63-457b8690b29a req-4cfc0d96-7155-417d-a284-ca55e738f2f7 service nova] Creating event network-changed:bdeef6a2-1b0c-458c-adee-98e42b80b14c for instance f4fc63ee-55ed-437c-81f4-4d658bf32051 on hv-cinder-86213 Oct 20 13:37:44.634895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d638f5f5-271d-461d-9c1f-d7c9b76bc1bb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:44.636174 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d638f5f5-271d-461d-9c1f-d7c9b76bc1bb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:44.643589 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-edd3b136-0a8c-4844-ac63-457b8690b29a req-4cfc0d96-7155-417d-a284-ca55e738f2f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073123 Oct 20 13:37:44.645112 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 133/257] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:44.696088 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6bf095f8-1b68-44ca-b51d-5b5e0c7811bd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:44.697078 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-6bf095f8-1b68-44ca-b51d-5b5e0c7811bd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:44.703859 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6bf095f8-1b68-44ca-b51d-5b5e0c7811bd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:44.704346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6bf095f8-1b68-44ca-b51d-5b5e0c7811bd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:44.704778 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6bf095f8-1b68-44ca-b51d-5b5e0c7811bd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:44.705495 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6bf095f8-1b68-44ca-b51d-5b5e0c7811bd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:44.705947 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6bf095f8-1b68-44ca-b51d-5b5e0c7811bd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:44.706366 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6bf095f8-1b68-44ca-b51d-5b5e0c7811bd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:44.847118 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-6bf095f8-1b68-44ca-b51d-5b5e0c7811bd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:44.855463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-6bf095f8-1b68-44ca-b51d-5b5e0c7811bd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.163521 Oct 20 13:37:44.856045 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 134/258] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:44 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:44.954561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d638f5f5-271d-461d-9c1f-d7c9b76bc1bb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:44.962729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d638f5f5-271d-461d-9c1f-d7c9b76bc1bb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1367 microversion: 2.1 time: 0.362785 Oct 20 13:37:44.963919 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 125/259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:44 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:44.967350 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-dd9715ec-b8d1-4e97-b214-48f4f6cc4790 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:44.967973 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-dd9715ec-b8d1-4e97-b214-48f4f6cc4790 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:44.974213 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dd9715ec-b8d1-4e97-b214-48f4f6cc4790 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:44.974732 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dd9715ec-b8d1-4e97-b214-48f4f6cc4790 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:44.975165 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dd9715ec-b8d1-4e97-b214-48f4f6cc4790 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:44.976050 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dd9715ec-b8d1-4e97-b214-48f4f6cc4790 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:44.976663 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dd9715ec-b8d1-4e97-b214-48f4f6cc4790 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:44.977114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dd9715ec-b8d1-4e97-b214-48f4f6cc4790 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:45.116484 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-dd9715ec-b8d1-4e97-b214-48f4f6cc4790 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:45.126112 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-dd9715ec-b8d1-4e97-b214-48f4f6cc4790 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1699 microversion: 2.1 time: 0.165185 Oct 20 13:37:45.126965 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 135/260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:44 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1699 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:45.149508 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0f29bbb2-4091-492d-82f6-0386befdbb17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:45.156915 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0f29bbb2-4091-492d-82f6-0386befdbb17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:45.157675 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0f29bbb2-4091-492d-82f6-0386befdbb17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:45.158163 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0f29bbb2-4091-492d-82f6-0386befdbb17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:45.377170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0f29bbb2-4091-492d-82f6-0386befdbb17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Going to try to start instance {{(pid=125448) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 20 13:37:45.403568 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:45.404516 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:45.411429 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:45.412180 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:45.412794 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:45.413700 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:45.414153 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:45.414736 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:45.440440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0f29bbb2-4091-492d-82f6-0386befdbb17 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/action" status: 202 len: 0 microversion: 2.1 time: 0.293289 Oct 20 13:37:45.444449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 126/261] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:37:45 2022] POST /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:37:45.449924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-847889a2-e747-478f-9a76-1752141b1f8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:45.450656 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-847889a2-e747-478f-9a76-1752141b1f8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:45.469123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-847889a2-e747-478f-9a76-1752141b1f8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:45.469593 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-847889a2-e747-478f-9a76-1752141b1f8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:45.470025 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-847889a2-e747-478f-9a76-1752141b1f8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:45.470726 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-847889a2-e747-478f-9a76-1752141b1f8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:45.471174 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-847889a2-e747-478f-9a76-1752141b1f8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:45.471591 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-847889a2-e747-478f-9a76-1752141b1f8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:45.610743 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:45.625620 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:45.628134 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:45.629538 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-98a2cfb5-b54a-4560-ba08-e55b31d978d9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.229846 Oct 20 13:37:45.630953 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 136/262] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:45 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:45.820309 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-847889a2-e747-478f-9a76-1752141b1f8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:45.835814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-847889a2-e747-478f-9a76-1752141b1f8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1708 microversion: 2.1 time: 0.389534 Oct 20 13:37:45.846519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 127/263] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:45 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1708 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:45.880354 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-03f2030d-81c8-44be-af0d-09f0df9c089e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:45.881352 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-03f2030d-81c8-44be-af0d-09f0df9c089e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:45.888012 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03f2030d-81c8-44be-af0d-09f0df9c089e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:45.888502 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03f2030d-81c8-44be-af0d-09f0df9c089e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:45.888996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03f2030d-81c8-44be-af0d-09f0df9c089e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:45.893285 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03f2030d-81c8-44be-af0d-09f0df9c089e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:45.893781 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03f2030d-81c8-44be-af0d-09f0df9c089e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:45.894223 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03f2030d-81c8-44be-af0d-09f0df9c089e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:45.986711 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1b4ac557-3683-4e8d-850e-371a3bdccf7c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:45.987428 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1b4ac557-3683-4e8d-850e-371a3bdccf7c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:45.993504 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b4ac557-3683-4e8d-850e-371a3bdccf7c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:45.994114 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b4ac557-3683-4e8d-850e-371a3bdccf7c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:45.994705 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b4ac557-3683-4e8d-850e-371a3bdccf7c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:45.995443 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b4ac557-3683-4e8d-850e-371a3bdccf7c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:45.995898 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b4ac557-3683-4e8d-850e-371a3bdccf7c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:45.996375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1b4ac557-3683-4e8d-850e-371a3bdccf7c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:46.035987 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-03f2030d-81c8-44be-af0d-09f0df9c089e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:46.043769 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-03f2030d-81c8-44be-af0d-09f0df9c089e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.168964 Oct 20 13:37:46.044335 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 137/264] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:45 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:46.143197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1b4ac557-3683-4e8d-850e-371a3bdccf7c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:46.151533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1b4ac557-3683-4e8d-850e-371a3bdccf7c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1367 microversion: 2.1 time: 0.169392 Oct 20 13:37:46.152324 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 128/265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:45 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:46.658735 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:46.659302 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:46.665302 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:46.665847 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:46.666282 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:46.667077 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:46.667420 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:46.667843 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:46.805375 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:46.814363 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:46.816135 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:46.817227 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b1e9370f-38e3-456c-a140-7bfdebe12e17 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.163209 Oct 20 13:37:46.817797 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 138/266] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:46 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:46.870866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d3ea0c67-d42b-4515-97f3-37523c1d0c6d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:46.871477 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d3ea0c67-d42b-4515-97f3-37523c1d0c6d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:46.878658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d3ea0c67-d42b-4515-97f3-37523c1d0c6d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:46.879140 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d3ea0c67-d42b-4515-97f3-37523c1d0c6d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:46.879574 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d3ea0c67-d42b-4515-97f3-37523c1d0c6d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:46.880261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d3ea0c67-d42b-4515-97f3-37523c1d0c6d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:46.880710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d3ea0c67-d42b-4515-97f3-37523c1d0c6d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:46.881198 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d3ea0c67-d42b-4515-97f3-37523c1d0c6d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:47.068230 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9db79878-2016-4e6a-a5bf-102757ae2ece tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:47.068985 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9db79878-2016-4e6a-a5bf-102757ae2ece tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:47.075420 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db79878-2016-4e6a-a5bf-102757ae2ece tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:47.075898 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db79878-2016-4e6a-a5bf-102757ae2ece tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:47.076329 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db79878-2016-4e6a-a5bf-102757ae2ece tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:47.077045 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db79878-2016-4e6a-a5bf-102757ae2ece tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:47.077499 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db79878-2016-4e6a-a5bf-102757ae2ece tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:47.077920 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db79878-2016-4e6a-a5bf-102757ae2ece tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:47.208416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d3ea0c67-d42b-4515-97f3-37523c1d0c6d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:47.215129 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9db79878-2016-4e6a-a5bf-102757ae2ece tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:47.217019 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d3ea0c67-d42b-4515-97f3-37523c1d0c6d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1708 microversion: 2.1 time: 0.349918 Oct 20 13:37:47.217811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 129/267] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:46 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1708 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:47.223190 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cd950059-ec57-402e-b7c3-34ed1f08fa9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:47.224160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cd950059-ec57-402e-b7c3-34ed1f08fa9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:47.226748 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9db79878-2016-4e6a-a5bf-102757ae2ece tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.162096 Oct 20 13:37:47.231994 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 139/268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:47 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:47.233789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd950059-ec57-402e-b7c3-34ed1f08fa9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:47.234495 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd950059-ec57-402e-b7c3-34ed1f08fa9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:47.235692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd950059-ec57-402e-b7c3-34ed1f08fa9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:47.236396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd950059-ec57-402e-b7c3-34ed1f08fa9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:47.236842 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd950059-ec57-402e-b7c3-34ed1f08fa9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:47.237285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd950059-ec57-402e-b7c3-34ed1f08fa9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:47.392245 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-479888061", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "networks": [{"uuid": "3d74f2a6-396d-4af0-8172-d2ba2f2834fd"}]}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:47.449418 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.network.neutron [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] validate_networks() for [('3d74f2a6-396d-4af0-8172-d2ba2f2834fd', None, None, None, None, None)] {{(pid=125447) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:37:47.491647 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd950059-ec57-402e-b7c3-34ed1f08fa9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:47.501959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cd950059-ec57-402e-b7c3-34ed1f08fa9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1367 microversion: 2.1 time: 0.281693 Oct 20 13:37:47.503674 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 130/269] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:47 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:47.820354 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Flavor limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:37:47.820750 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Image limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:37:47.821241 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Flavor pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:37:47.821642 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Image pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:37:47.822077 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:37:47.830893 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:47.831360 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:47.831786 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:47.832497 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:47.832982 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:47.833403 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:47.843743 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:47.844933 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:47.851077 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:47.851562 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:47.851902 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Getting quotas for project c189090d654b46c880b0d40f1e46a563. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:37:47.852014 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:47.852710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:47.853214 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:47.853642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:47.855837 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Getting quotas for user 41c8c7437dd9443d8ddf4d10d8da6758 and project c189090d654b46c880b0d40f1e46a563. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:37:47.867498 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Going to run 1 instances... {{(pid=125447) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:37:47.870229 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125447) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:37:47.918628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a053ec12-9c98-4c48-978a-580cae97d216 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530298 Oct 20 13:37:47.925769 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 140/270] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:37:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 13:37:47.934025 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3397f69f-1104-44d9-966e-267844181195 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:47.935473 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3397f69f-1104-44d9-966e-267844181195 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:47.995701 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3397f69f-1104-44d9-966e-267844181195 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:47.999414 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:48.006000 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3397f69f-1104-44d9-966e-267844181195 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1218 microversion: 2.1 time: 0.078253 Oct 20 13:37:48.007128 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 141/271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:47 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:48.009738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:48.011187 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:48.012410 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2f8c7fbb-879c-4571-ba85-c529a505168b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.172719 Oct 20 13:37:48.025142 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 131/272] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:47 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:37:48.241982 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-181a7150-2199-44cc-b5b5-b5737fd01ee4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:48.242998 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-181a7150-2199-44cc-b5b5-b5737fd01ee4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:48.252893 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-181a7150-2199-44cc-b5b5-b5737fd01ee4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:48.253581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-181a7150-2199-44cc-b5b5-b5737fd01ee4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:48.254125 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-181a7150-2199-44cc-b5b5-b5737fd01ee4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:48.254866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d6ce3c57-8142-4f33-9d18-e24a6e763f38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:48.255023 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-181a7150-2199-44cc-b5b5-b5737fd01ee4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:48.255489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d6ce3c57-8142-4f33-9d18-e24a6e763f38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:48.255651 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-181a7150-2199-44cc-b5b5-b5737fd01ee4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:48.256195 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-181a7150-2199-44cc-b5b5-b5737fd01ee4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:48.262577 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ce3c57-8142-4f33-9d18-e24a6e763f38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:48.263236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ce3c57-8142-4f33-9d18-e24a6e763f38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:48.264049 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ce3c57-8142-4f33-9d18-e24a6e763f38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:48.265180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ce3c57-8142-4f33-9d18-e24a6e763f38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:48.265872 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ce3c57-8142-4f33-9d18-e24a6e763f38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:48.266570 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ce3c57-8142-4f33-9d18-e24a6e763f38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:48.477658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d6ce3c57-8142-4f33-9d18-e24a6e763f38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:48.478162 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-181a7150-2199-44cc-b5b5-b5737fd01ee4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:48.490177 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-181a7150-2199-44cc-b5b5-b5737fd01ee4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1708 microversion: 2.1 time: 0.251925 Oct 20 13:37:48.491194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 142/273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:48 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1708 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:48.492432 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d6ce3c57-8142-4f33-9d18-e24a6e763f38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.242280 Oct 20 13:37:48.508105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 132/274] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:48 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:48.529283 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c8178288-28e0-41d3-88bb-32b2016d5cca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:48.529903 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-c8178288-28e0-41d3-88bb-32b2016d5cca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:48.539852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c8178288-28e0-41d3-88bb-32b2016d5cca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:48.540349 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c8178288-28e0-41d3-88bb-32b2016d5cca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:48.540786 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c8178288-28e0-41d3-88bb-32b2016d5cca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:48.541521 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c8178288-28e0-41d3-88bb-32b2016d5cca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:48.541974 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c8178288-28e0-41d3-88bb-32b2016d5cca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:48.542410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c8178288-28e0-41d3-88bb-32b2016d5cca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:48.709282 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c8178288-28e0-41d3-88bb-32b2016d5cca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:48.718270 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-c8178288-28e0-41d3-88bb-32b2016d5cca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1367 microversion: 2.1 time: 0.195252 Oct 20 13:37:48.718847 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 143/275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:48 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:49.029819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-468b1510-1211-49cf-a3b8-8c592286f4cc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:49.030431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-468b1510-1211-49cf-a3b8-8c592286f4cc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:49.038771 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:49.039336 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-468b1510-1211-49cf-a3b8-8c592286f4cc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:49.039433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:49.039512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-468b1510-1211-49cf-a3b8-8c592286f4cc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:49.039687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-468b1510-1211-49cf-a3b8-8c592286f4cc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:49.040727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-468b1510-1211-49cf-a3b8-8c592286f4cc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:49.041337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-468b1510-1211-49cf-a3b8-8c592286f4cc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:49.041825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-468b1510-1211-49cf-a3b8-8c592286f4cc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:49.049910 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:49.050399 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:49.052751 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:49.053519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:49.053967 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:49.054394 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:49.117680 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-468b1510-1211-49cf-a3b8-8c592286f4cc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:49.126672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-468b1510-1211-49cf-a3b8-8c592286f4cc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1270 microversion: 2.1 time: 0.099978 Oct 20 13:37:49.127530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 133/276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:49 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:49.205645 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:49.213806 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:49.215255 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:49.216400 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9d6a1ded-fc0a-4429-ae2e-838d9ed2fc53 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.181776 Oct 20 13:37:49.216973 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 144/277] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:49 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:37:49.514553 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:49.517969 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9631f2fc-42b9-4db0-bd2b-d985da56810f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:49.518849 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9631f2fc-42b9-4db0-bd2b-d985da56810f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:49.520970 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7f820660-1eab-4ae4-85b9-ff85822632e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:49.521599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7f820660-1eab-4ae4-85b9-ff85822632e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:49.525191 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9631f2fc-42b9-4db0-bd2b-d985da56810f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:49.525819 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9631f2fc-42b9-4db0-bd2b-d985da56810f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:49.526412 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9631f2fc-42b9-4db0-bd2b-d985da56810f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:49.531239 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f820660-1eab-4ae4-85b9-ff85822632e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:49.532598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f820660-1eab-4ae4-85b9-ff85822632e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:49.534157 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f820660-1eab-4ae4-85b9-ff85822632e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:49.535280 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f820660-1eab-4ae4-85b9-ff85822632e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:49.535759 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f820660-1eab-4ae4-85b9-ff85822632e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:49.536357 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f820660-1eab-4ae4-85b9-ff85822632e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:49.537131 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9631f2fc-42b9-4db0-bd2b-d985da56810f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:49.539613 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9631f2fc-42b9-4db0-bd2b-d985da56810f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:49.540399 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9631f2fc-42b9-4db0-bd2b-d985da56810f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:49.695452 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9631f2fc-42b9-4db0-bd2b-d985da56810f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:49.704899 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9631f2fc-42b9-4db0-bd2b-d985da56810f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1712 microversion: 2.1 time: 0.192156 Oct 20 13:37:49.705482 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 145/278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:49 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1712 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:49.741781 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d93b909f-8c5b-473f-a323-feeb50e025c7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:49.742531 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d93b909f-8c5b-473f-a323-feeb50e025c7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:49.749204 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d93b909f-8c5b-473f-a323-feeb50e025c7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:49.749961 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d93b909f-8c5b-473f-a323-feeb50e025c7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:49.750849 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d93b909f-8c5b-473f-a323-feeb50e025c7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:49.751901 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d93b909f-8c5b-473f-a323-feeb50e025c7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:49.752608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d93b909f-8c5b-473f-a323-feeb50e025c7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:49.753134 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d93b909f-8c5b-473f-a323-feeb50e025c7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:49.757968 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7f820660-1eab-4ae4-85b9-ff85822632e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:49.765861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7f820660-1eab-4ae4-85b9-ff85822632e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.252227 Oct 20 13:37:49.766923 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 134/279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:49 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:49.888189 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d93b909f-8c5b-473f-a323-feeb50e025c7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:49.896778 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d93b909f-8c5b-473f-a323-feeb50e025c7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1367 microversion: 2.1 time: 0.159349 Oct 20 13:37:49.897448 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 146/280] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:49 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:50.150374 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1269c99d-c70e-478b-a489-80f1a8aeedaa tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:50.151703 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1269c99d-c70e-478b-a489-80f1a8aeedaa tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:50.155556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=8 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:50.161868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1269c99d-c70e-478b-a489-80f1a8aeedaa tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:50.162433 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1269c99d-c70e-478b-a489-80f1a8aeedaa tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:50.162934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1269c99d-c70e-478b-a489-80f1a8aeedaa tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:50.163772 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1269c99d-c70e-478b-a489-80f1a8aeedaa tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:50.164227 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1269c99d-c70e-478b-a489-80f1a8aeedaa tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:50.164737 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1269c99d-c70e-478b-a489-80f1a8aeedaa tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:50.247343 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:50.248771 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:50.255571 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:50.256353 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:50.257041 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:50.257749 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:50.258226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:50.258861 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:50.408675 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:50.419574 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:50.421233 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:50.424978 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-db6d7244-435c-42a9-a467-a82f753f0d50 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.181451 Oct 20 13:37:50.436892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 147/281] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:50 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:37:50.436892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-2eb71d17-a6df-4013-8540-e6d3dc000f2e req-d730713c-d9a9-4966-b847-16bacdf1f4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4fc63ee-55ed-437c-81f4-4d658bf32051", "name": "network-vif-plugged", "status": "completed", "tag": "bdeef6a2-1b0c-458c-adee-98e42b80b14c"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:50.444025 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-2eb71d17-a6df-4013-8540-e6d3dc000f2e req-d730713c-d9a9-4966-b847-16bacdf1f4b2 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:50.445037 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-2eb71d17-a6df-4013-8540-e6d3dc000f2e req-d730713c-d9a9-4966-b847-16bacdf1f4b2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:50.445037 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-2eb71d17-a6df-4013-8540-e6d3dc000f2e req-d730713c-d9a9-4966-b847-16bacdf1f4b2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:50.461608 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-2eb71d17-a6df-4013-8540-e6d3dc000f2e req-d730713c-d9a9-4966-b847-16bacdf1f4b2 service nova] Creating event network-vif-plugged:bdeef6a2-1b0c-458c-adee-98e42b80b14c for instance f4fc63ee-55ed-437c-81f4-4d658bf32051 on hv-cinder-86213 Oct 20 13:37:50.466923 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-2eb71d17-a6df-4013-8540-e6d3dc000f2e req-d730713c-d9a9-4966-b847-16bacdf1f4b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039718 Oct 20 13:37:50.468406 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 148/282] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:50.676192 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1269c99d-c70e-478b-a489-80f1a8aeedaa tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:50.684098 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1269c99d-c70e-478b-a489-80f1a8aeedaa tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.537574 Oct 20 13:37:50.684689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 135/283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:50 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:50.792344 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f6428dd1-6632-4576-937b-48c222fd6e45 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:50.793147 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-f6428dd1-6632-4576-937b-48c222fd6e45 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:50.801096 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6428dd1-6632-4576-937b-48c222fd6e45 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:50.801582 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6428dd1-6632-4576-937b-48c222fd6e45 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:50.802049 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6428dd1-6632-4576-937b-48c222fd6e45 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:50.802736 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6428dd1-6632-4576-937b-48c222fd6e45 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:50.803214 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6428dd1-6632-4576-937b-48c222fd6e45 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:50.803633 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6428dd1-6632-4576-937b-48c222fd6e45 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:50.919622 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-44541022-acc6-4b10-929d-9af55a7bfe9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:50.920243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-44541022-acc6-4b10-929d-9af55a7bfe9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:50.928937 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-44541022-acc6-4b10-929d-9af55a7bfe9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:50.929466 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-44541022-acc6-4b10-929d-9af55a7bfe9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:50.930076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-44541022-acc6-4b10-929d-9af55a7bfe9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:50.930960 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-44541022-acc6-4b10-929d-9af55a7bfe9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:50.931406 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-44541022-acc6-4b10-929d-9af55a7bfe9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:50.931819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-44541022-acc6-4b10-929d-9af55a7bfe9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:50.941028 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-f6428dd1-6632-4576-937b-48c222fd6e45 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:50.949458 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-f6428dd1-6632-4576-937b-48c222fd6e45 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.161613 Oct 20 13:37:50.950163 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 149/284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:50 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:51.142180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-44541022-acc6-4b10-929d-9af55a7bfe9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:51.150361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-44541022-acc6-4b10-929d-9af55a7bfe9e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1367 microversion: 2.1 time: 0.234530 Oct 20 13:37:51.150931 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 136/285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:50 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:51.445446 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-ea1e3b8c-d096-4fbf-85a7-b9816c945517 req-57f01f6a-cdd1-4437-a886-4558846bc645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0787959c-f72a-4c43-9d8e-99727c31a00e", "tag": "48e38ca1-0978-43a8-a28f-176c07485795"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:51.454291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:51.454291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:51.456034 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-ea1e3b8c-d096-4fbf-85a7-b9816c945517 req-57f01f6a-cdd1-4437-a886-4558846bc645 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:51.456514 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-ea1e3b8c-d096-4fbf-85a7-b9816c945517 req-57f01f6a-cdd1-4437-a886-4558846bc645 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:51.456957 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-ea1e3b8c-d096-4fbf-85a7-b9816c945517 req-57f01f6a-cdd1-4437-a886-4558846bc645 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:51.462620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:51.463228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:51.463842 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:51.464644 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:51.465329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:51.465825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:51.467981 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-ea1e3b8c-d096-4fbf-85a7-b9816c945517 req-57f01f6a-cdd1-4437-a886-4558846bc645 service nova] Creating event network-changed:48e38ca1-0978-43a8-a28f-176c07485795 for instance 0787959c-f72a-4c43-9d8e-99727c31a00e on hv-cinder-86213 Oct 20 13:37:51.473411 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-ea1e3b8c-d096-4fbf-85a7-b9816c945517 req-57f01f6a-cdd1-4437-a886-4558846bc645 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031624 Oct 20 13:37:51.474191 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 150/286] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:51.601828 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:51.613369 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:51.614849 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:51.616364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b7ada987-43d2-48aa-acfa-4998f7787a8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.167911 Oct 20 13:37:51.617172 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 137/287] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:51 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:37:51.708203 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7c41998e-bbae-47cd-9caa-88450dad017d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:51.708972 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7c41998e-bbae-47cd-9caa-88450dad017d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:51.715327 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7c41998e-bbae-47cd-9caa-88450dad017d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:51.715837 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7c41998e-bbae-47cd-9caa-88450dad017d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:51.716277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7c41998e-bbae-47cd-9caa-88450dad017d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:51.717002 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7c41998e-bbae-47cd-9caa-88450dad017d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:51.717443 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7c41998e-bbae-47cd-9caa-88450dad017d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:51.717867 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7c41998e-bbae-47cd-9caa-88450dad017d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:51.856963 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7c41998e-bbae-47cd-9caa-88450dad017d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:51.865044 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7c41998e-bbae-47cd-9caa-88450dad017d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.161074 Oct 20 13:37:51.865617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 151/288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:51 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:51.974693 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9dbcecd3-0799-4611-b2a0-03a7fd62ce8c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:51.975300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9dbcecd3-0799-4611-b2a0-03a7fd62ce8c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:51.981408 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9dbcecd3-0799-4611-b2a0-03a7fd62ce8c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:51.981887 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9dbcecd3-0799-4611-b2a0-03a7fd62ce8c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:51.982312 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9dbcecd3-0799-4611-b2a0-03a7fd62ce8c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:51.982993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9dbcecd3-0799-4611-b2a0-03a7fd62ce8c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:51.983437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9dbcecd3-0799-4611-b2a0-03a7fd62ce8c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:51.983852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9dbcecd3-0799-4611-b2a0-03a7fd62ce8c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:52.175250 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7da8a891-93cf-47fd-9e0c-7e1a0ddad4b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:52.175904 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7da8a891-93cf-47fd-9e0c-7e1a0ddad4b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:52.182205 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7da8a891-93cf-47fd-9e0c-7e1a0ddad4b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:52.182697 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7da8a891-93cf-47fd-9e0c-7e1a0ddad4b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:52.183137 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7da8a891-93cf-47fd-9e0c-7e1a0ddad4b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:52.183838 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7da8a891-93cf-47fd-9e0c-7e1a0ddad4b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:52.184302 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7da8a891-93cf-47fd-9e0c-7e1a0ddad4b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:52.184728 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7da8a891-93cf-47fd-9e0c-7e1a0ddad4b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:52.189519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=100 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:52.264659 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9dbcecd3-0799-4611-b2a0-03a7fd62ce8c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:52.274342 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9dbcecd3-0799-4611-b2a0-03a7fd62ce8c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.303392 Oct 20 13:37:52.274934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 138/289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:51 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:52.336903 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7da8a891-93cf-47fd-9e0c-7e1a0ddad4b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:52.345070 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7da8a891-93cf-47fd-9e0c-7e1a0ddad4b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1557 microversion: 2.1 time: 0.174147 Oct 20 13:37:52.345651 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 152/290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:52 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:52.367429 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fcc3bd40-0f77-41df-b8c5-40163abfadcd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:52.367958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fcc3bd40-0f77-41df-b8c5-40163abfadcd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:52.374105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fcc3bd40-0f77-41df-b8c5-40163abfadcd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:52.374595 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fcc3bd40-0f77-41df-b8c5-40163abfadcd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:52.375033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fcc3bd40-0f77-41df-b8c5-40163abfadcd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:52.376514 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fcc3bd40-0f77-41df-b8c5-40163abfadcd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:52.377001 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fcc3bd40-0f77-41df-b8c5-40163abfadcd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:52.377426 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fcc3bd40-0f77-41df-b8c5-40163abfadcd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:52.381300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:52.457933 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fcc3bd40-0f77-41df-b8c5-40163abfadcd tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094617 Oct 20 13:37:52.458527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 139/291] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 20 13:37:52 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:52.643821 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:52.644415 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:52.650777 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:52.651268 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:52.651719 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:52.652403 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:52.652993 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:52.653546 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:52.808836 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:52.817702 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:52.819154 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:52.820353 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0adeb353-7748-4ef3-a642-e6556e4e0f5d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.181192 Oct 20 13:37:52.820906 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 153/292] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:52 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:52.890334 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f3fe334e-b251-4824-987f-bb652aaf3174 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:52.891000 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f3fe334e-b251-4824-987f-bb652aaf3174 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:52.897188 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f3fe334e-b251-4824-987f-bb652aaf3174 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:52.897664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f3fe334e-b251-4824-987f-bb652aaf3174 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:52.898086 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f3fe334e-b251-4824-987f-bb652aaf3174 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:52.898762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f3fe334e-b251-4824-987f-bb652aaf3174 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:52.899202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f3fe334e-b251-4824-987f-bb652aaf3174 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:52.899628 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f3fe334e-b251-4824-987f-bb652aaf3174 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:53.269101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f3fe334e-b251-4824-987f-bb652aaf3174 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:53.276982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f3fe334e-b251-4824-987f-bb652aaf3174 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.393010 Oct 20 13:37:53.278453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 140/293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:52 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:53.298181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-953571a5-0099-4ff4-be19-968165971046 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:53.298795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-953571a5-0099-4ff4-be19-968165971046 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:53.307176 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-953571a5-0099-4ff4-be19-968165971046 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:53.307663 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-953571a5-0099-4ff4-be19-968165971046 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:53.308095 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-953571a5-0099-4ff4-be19-968165971046 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:53.308789 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-953571a5-0099-4ff4-be19-968165971046 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:53.309272 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-953571a5-0099-4ff4-be19-968165971046 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:53.309695 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-953571a5-0099-4ff4-be19-968165971046 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:53.444934 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-953571a5-0099-4ff4-be19-968165971046 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:53.456238 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-953571a5-0099-4ff4-be19-968165971046 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.162571 Oct 20 13:37:53.457176 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 154/294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:53 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:53.846752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:53.847361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:53.853557 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:53.854071 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:53.854500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:53.855183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:53.855628 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:53.856042 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:54.143707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:54.151939 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:54.153446 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:54.154647 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-72ff6058-5919-47cc-998e-bb0430214ebd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1743 microversion: 2.20 time: 0.312126 Oct 20 13:37:54.155893 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 141/295] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:53 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1743 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:54.196132 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-e1aa64bb-6e93-499d-a197-22b702d89906 req-549acaf3-7ad6-4856-a929-ca5462c96f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4fc63ee-55ed-437c-81f4-4d658bf32051", "tag": "bdeef6a2-1b0c-458c-adee-98e42b80b14c"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:54.206766 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-e1aa64bb-6e93-499d-a197-22b702d89906 req-549acaf3-7ad6-4856-a929-ca5462c96f5c service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:54.207240 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-e1aa64bb-6e93-499d-a197-22b702d89906 req-549acaf3-7ad6-4856-a929-ca5462c96f5c service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:54.207675 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-e1aa64bb-6e93-499d-a197-22b702d89906 req-549acaf3-7ad6-4856-a929-ca5462c96f5c service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:54.218609 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-e1aa64bb-6e93-499d-a197-22b702d89906 req-549acaf3-7ad6-4856-a929-ca5462c96f5c service nova] Creating event network-changed:bdeef6a2-1b0c-458c-adee-98e42b80b14c for instance f4fc63ee-55ed-437c-81f4-4d658bf32051 on hv-cinder-86213 Oct 20 13:37:54.225757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-e1aa64bb-6e93-499d-a197-22b702d89906 req-549acaf3-7ad6-4856-a929-ca5462c96f5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033386 Oct 20 13:37:54.226346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 155/296] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:54.303604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-345aa86d-a315-416d-9bf0-d29cf6471641 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:54.304235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-345aa86d-a315-416d-9bf0-d29cf6471641 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:54.310075 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-345aa86d-a315-416d-9bf0-d29cf6471641 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:54.310554 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-345aa86d-a315-416d-9bf0-d29cf6471641 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:54.310987 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-345aa86d-a315-416d-9bf0-d29cf6471641 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:54.312085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-345aa86d-a315-416d-9bf0-d29cf6471641 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:54.312550 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-345aa86d-a315-416d-9bf0-d29cf6471641 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:54.313231 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-345aa86d-a315-416d-9bf0-d29cf6471641 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:54.443851 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-345aa86d-a315-416d-9bf0-d29cf6471641 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:54.451537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-345aa86d-a315-416d-9bf0-d29cf6471641 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.151745 Oct 20 13:37:54.452297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 142/297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:54 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:54.480093 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6179f60b-46c3-470a-a436-a19335980b3c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:54.480805 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-6179f60b-46c3-470a-a436-a19335980b3c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:54.487075 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6179f60b-46c3-470a-a436-a19335980b3c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:54.487552 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6179f60b-46c3-470a-a436-a19335980b3c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:54.487982 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6179f60b-46c3-470a-a436-a19335980b3c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:54.488668 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6179f60b-46c3-470a-a436-a19335980b3c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:54.489137 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6179f60b-46c3-470a-a436-a19335980b3c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:54.489743 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6179f60b-46c3-470a-a436-a19335980b3c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:54.628014 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-6179f60b-46c3-470a-a436-a19335980b3c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:54.636456 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-6179f60b-46c3-470a-a436-a19335980b3c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.160259 Oct 20 13:37:54.637234 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 156/298] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:54 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:55.184607 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:55.185301 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:55.193739 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:55.194595 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:55.195048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:55.196047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:55.196652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:55.197194 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:55.346903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:55.366164 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:55.368540 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:55.369831 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c3178126-9060-40b9-bc18-57e507dade29 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1743 microversion: 2.20 time: 0.189968 Oct 20 13:37:55.370400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 143/299] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:55 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1743 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:55.479323 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-1bfe771a-91a7-47d0-9424-3295f0b1a909 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:55.480093 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-1bfe771a-91a7-47d0-9424-3295f0b1a909 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:55.488132 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1bfe771a-91a7-47d0-9424-3295f0b1a909 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:55.488618 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1bfe771a-91a7-47d0-9424-3295f0b1a909 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:55.489078 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1bfe771a-91a7-47d0-9424-3295f0b1a909 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:55.489778 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1bfe771a-91a7-47d0-9424-3295f0b1a909 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:55.490221 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1bfe771a-91a7-47d0-9424-3295f0b1a909 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:55.490756 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1bfe771a-91a7-47d0-9424-3295f0b1a909 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:55.651539 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-1bfe771a-91a7-47d0-9424-3295f0b1a909 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:55.661095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d6ded662-18fd-4a23-9f49-3b0bbe250f0c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:55.661294 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-1bfe771a-91a7-47d0-9424-3295f0b1a909 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.189337 Oct 20 13:37:55.668781 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 157/300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:55 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:55.670096 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d6ded662-18fd-4a23-9f49-3b0bbe250f0c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:55.678327 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ded662-18fd-4a23-9f49-3b0bbe250f0c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:55.679169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ded662-18fd-4a23-9f49-3b0bbe250f0c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:55.680076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ded662-18fd-4a23-9f49-3b0bbe250f0c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:55.680982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ded662-18fd-4a23-9f49-3b0bbe250f0c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:55.681606 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ded662-18fd-4a23-9f49-3b0bbe250f0c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:55.682105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6ded662-18fd-4a23-9f49-3b0bbe250f0c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:55.897537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d6ded662-18fd-4a23-9f49-3b0bbe250f0c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:55.905884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d6ded662-18fd-4a23-9f49-3b0bbe250f0c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.250082 Oct 20 13:37:55.918755 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 144/301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:55 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:37:56.403756 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:56.404451 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:56.405165 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-f100f675-338c-40d1-ac93-59cd3678dac5 req-6955f206-79cb-440e-a495-8e09bf0ad66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b9ae5b-1e55-409f-9a61-b1e2a47d1b58", "name": "network-vif-plugged", "status": "completed", "tag": "c4329cd6-ac99-4465-b271-c87f6eb593c4"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:56.411474 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:56.412187 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:56.412670 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:56.413810 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:56.414446 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:56.414879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:56.417266 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f100f675-338c-40d1-ac93-59cd3678dac5 req-6955f206-79cb-440e-a495-8e09bf0ad66e service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:56.417751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f100f675-338c-40d1-ac93-59cd3678dac5 req-6955f206-79cb-440e-a495-8e09bf0ad66e service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:56.418180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f100f675-338c-40d1-ac93-59cd3678dac5 req-6955f206-79cb-440e-a495-8e09bf0ad66e service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:56.444440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-f100f675-338c-40d1-ac93-59cd3678dac5 req-6955f206-79cb-440e-a495-8e09bf0ad66e service nova] Creating event network-vif-plugged:c4329cd6-ac99-4465-b271-c87f6eb593c4 for instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 on hv-cinder-86213 Oct 20 13:37:56.457609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-f100f675-338c-40d1-ac93-59cd3678dac5 req-6955f206-79cb-440e-a495-8e09bf0ad66e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055805 Oct 20 13:37:56.458736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 145/302] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:37:56.560413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:56.570070 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:56.571527 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:56.572678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e9361bf5-84a4-484b-8761-b8e7d1f28719 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1738 microversion: 2.20 time: 0.174088 Oct 20 13:37:56.573278 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 158/303] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:56 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:56.685688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0f28d2b1-c387-406e-b928-833848f54105 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:56.687183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0f28d2b1-c387-406e-b928-833848f54105 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:56.693929 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0f28d2b1-c387-406e-b928-833848f54105 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:56.694779 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0f28d2b1-c387-406e-b928-833848f54105 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:56.695416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0f28d2b1-c387-406e-b928-833848f54105 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:56.696285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0f28d2b1-c387-406e-b928-833848f54105 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:56.697056 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0f28d2b1-c387-406e-b928-833848f54105 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:56.697567 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0f28d2b1-c387-406e-b928-833848f54105 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:56.845793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0f28d2b1-c387-406e-b928-833848f54105 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:56.853871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0f28d2b1-c387-406e-b928-833848f54105 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.172663 Oct 20 13:37:56.868752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 146/304] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:56 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:56.937774 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9a0b17c5-ccd6-4436-bab7-d200797dd0ec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:56.938316 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9a0b17c5-ccd6-4436-bab7-d200797dd0ec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:56.952883 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a0b17c5-ccd6-4436-bab7-d200797dd0ec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:56.952883 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a0b17c5-ccd6-4436-bab7-d200797dd0ec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:56.952883 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a0b17c5-ccd6-4436-bab7-d200797dd0ec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:56.952883 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a0b17c5-ccd6-4436-bab7-d200797dd0ec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:56.953321 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a0b17c5-ccd6-4436-bab7-d200797dd0ec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:56.953561 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a0b17c5-ccd6-4436-bab7-d200797dd0ec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:57.136716 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9a0b17c5-ccd6-4436-bab7-d200797dd0ec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:57.145002 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9a0b17c5-ccd6-4436-bab7-d200797dd0ec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.218157 Oct 20 13:37:57.145553 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 159/305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:56 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:57.599488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:57.601113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:57.612294 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:57.613166 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:57.613912 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:57.614661 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:57.615228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:57.615709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:57.764017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:57.773973 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:57.775196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:57.777412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5ea34237-5fda-449b-8bed-062f386fcccd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1738 microversion: 2.20 time: 0.181884 Oct 20 13:37:57.778658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 147/306] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:57 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:57.877035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-09d41085-437f-4859-a59c-18ad0ea99c7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:57.878595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-09d41085-437f-4859-a59c-18ad0ea99c7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:57.884821 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=2 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:57.886378 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09d41085-437f-4859-a59c-18ad0ea99c7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:57.886951 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09d41085-437f-4859-a59c-18ad0ea99c7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:57.887386 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09d41085-437f-4859-a59c-18ad0ea99c7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:57.888211 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09d41085-437f-4859-a59c-18ad0ea99c7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:57.888597 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09d41085-437f-4859-a59c-18ad0ea99c7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:57.889062 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09d41085-437f-4859-a59c-18ad0ea99c7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:58.001110 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=16 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:58.049440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-09d41085-437f-4859-a59c-18ad0ea99c7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:58.057855 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-09d41085-437f-4859-a59c-18ad0ea99c7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.185152 Oct 20 13:37:58.058431 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 160/307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:57 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:58.172985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9429ee21-2bf9-4a48-a633-bc8059a2c14a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:58.175035 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9429ee21-2bf9-4a48-a633-bc8059a2c14a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:58.181906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9429ee21-2bf9-4a48-a633-bc8059a2c14a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:58.182568 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9429ee21-2bf9-4a48-a633-bc8059a2c14a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:58.183106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9429ee21-2bf9-4a48-a633-bc8059a2c14a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:58.184050 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9429ee21-2bf9-4a48-a633-bc8059a2c14a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:58.184837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9429ee21-2bf9-4a48-a633-bc8059a2c14a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:58.185383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9429ee21-2bf9-4a48-a633-bc8059a2c14a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:58.336808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9429ee21-2bf9-4a48-a633-bc8059a2c14a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:58.347679 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9429ee21-2bf9-4a48-a633-bc8059a2c14a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.179832 Oct 20 13:37:58.349825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 148/308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:58 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:58.822808 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:58.824466 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:58.826668 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:58.833465 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:58.834233 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:58.834858 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:58.835760 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:58.836450 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:58.837132 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:59.020283 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:59.031263 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:59.033088 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:59.034260 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-fbc92f8d-6278-49c0-acbb-4d3dda83c5b2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1738 microversion: 2.20 time: 0.218274 Oct 20 13:37:59.034836 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 161/309] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:37:58 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:37:59.090287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-02495457-0f3c-4a10-9677-64162adbb239 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:59.090898 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-02495457-0f3c-4a10-9677-64162adbb239 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:59.100085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02495457-0f3c-4a10-9677-64162adbb239 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:59.100806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02495457-0f3c-4a10-9677-64162adbb239 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:59.101475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02495457-0f3c-4a10-9677-64162adbb239 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:59.102501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02495457-0f3c-4a10-9677-64162adbb239 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:59.103189 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02495457-0f3c-4a10-9677-64162adbb239 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:59.104740 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02495457-0f3c-4a10-9677-64162adbb239 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:59.307262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-02495457-0f3c-4a10-9677-64162adbb239 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:59.317941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-02495457-0f3c-4a10-9677-64162adbb239 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.231184 Oct 20 13:37:59.333349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 149/310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:59 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:59.371002 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1535568949", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1334420547", "security_groups": [{"name": "tempest-secgroup-smoke-1530929524"}], "block_device_mapping_v2": [{"uuid": "4b2d5a16-ef1e-4a76-8e54-f5293ab87ade", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2d938c2-510e-4c09-96e0-662b0c7b6d79"}]}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:37:59.371536 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-37d61c3d-ca4e-4646-b1e6-5503faedcfca tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:37:59.372276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-37d61c3d-ca4e-4646-b1e6-5503faedcfca tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:37:59.379313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37d61c3d-ca4e-4646-b1e6-5503faedcfca tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:59.379895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37d61c3d-ca4e-4646-b1e6-5503faedcfca tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:59.380393 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37d61c3d-ca4e-4646-b1e6-5503faedcfca tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:59.381199 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37d61c3d-ca4e-4646-b1e6-5503faedcfca tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:59.381748 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37d61c3d-ca4e-4646-b1e6-5503faedcfca tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:59.382232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37d61c3d-ca4e-4646-b1e6-5503faedcfca tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:59.503184 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.network.neutron [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] validate_networks() for [('a2d938c2-510e-4c09-96e0-662b0c7b6d79', None, None, None, None, None)] {{(pid=125447) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:37:59.559613 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-37d61c3d-ca4e-4646-b1e6-5503faedcfca tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:37:59.568568 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-37d61c3d-ca4e-4646-b1e6-5503faedcfca tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.200960 Oct 20 13:37:59.569190 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 150/311] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:37:59 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:37:59.945193 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Flavor limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:37:59.946126 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Image limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:37:59.946772 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Flavor pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:37:59.947359 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Image pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:37:59.947831 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:37:59.956856 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:59.957360 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:59.957975 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:59.958887 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:37:59.960112 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:37:59.960112 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:37:59.979197 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Getting quotas for project 32ef0737a3844bfe8f4bc14b09ebc88b. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:37:59.983832 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Getting quotas for user c9ac26a28e7b416b9786ddcacea5928e and project 32ef0737a3844bfe8f4bc14b09ebc88b. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:38:00.048778 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Going to run 1 instances... {{(pid=125447) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:38:00.051178 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b2d5a16-ef1e-4a76-8e54-f5293ab87ade',volume_size=None,volume_type=None)] {{(pid=125447) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:38:00.061915 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:00.063650 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:00.085240 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:00.086124 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:00.086781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:00.088309 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:00.089029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:00.089662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:00.220099 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-f04d2daa-3f12-486c-bc24-d1a4ad9f9fe7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.853160 Oct 20 13:38:00.228073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 162/312] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:37:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 13:38:00.244615 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e79a2fac-6dac-41ac-aada-6b50c5fcc7a0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:00.260283 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e79a2fac-6dac-41ac-aada-6b50c5fcc7a0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:00.322357 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:00.331598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:00.340009 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:00.341278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-72ea7d7b-aab4-4d4c-bf07-8b6f2ff8b047 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1738 microversion: 2.20 time: 0.283380 Oct 20 13:38:00.356895 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e79a2fac-6dac-41ac-aada-6b50c5fcc7a0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:00.356895 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e79a2fac-6dac-41ac-aada-6b50c5fcc7a0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1095 microversion: 2.1 time: 0.125373 Oct 20 13:38:00.356895 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 163/313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:00 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1095 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:00.373713 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 151/314] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:00 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:00.384566 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-2925c8d4-7b6b-42b7-a68c-7a41ba54dd8b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:00.385212 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-2925c8d4-7b6b-42b7-a68c-7a41ba54dd8b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:00.405818 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2925c8d4-7b6b-42b7-a68c-7a41ba54dd8b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:00.406953 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2925c8d4-7b6b-42b7-a68c-7a41ba54dd8b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:00.407478 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2925c8d4-7b6b-42b7-a68c-7a41ba54dd8b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:00.408205 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2925c8d4-7b6b-42b7-a68c-7a41ba54dd8b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:00.408668 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2925c8d4-7b6b-42b7-a68c-7a41ba54dd8b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:00.420076 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2925c8d4-7b6b-42b7-a68c-7a41ba54dd8b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:00.581579 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-2925c8d4-7b6b-42b7-a68c-7a41ba54dd8b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:00.591219 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-2925c8d4-7b6b-42b7-a68c-7a41ba54dd8b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.213596 Oct 20 13:38:00.592021 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 164/315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:00 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:00.595091 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6577af5b-f8e2-48bb-86e7-7367af791184 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:00.595712 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6577af5b-f8e2-48bb-86e7-7367af791184 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:00.615297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6577af5b-f8e2-48bb-86e7-7367af791184 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:00.615907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6577af5b-f8e2-48bb-86e7-7367af791184 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:00.617176 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6577af5b-f8e2-48bb-86e7-7367af791184 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:00.624430 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6577af5b-f8e2-48bb-86e7-7367af791184 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:00.625730 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6577af5b-f8e2-48bb-86e7-7367af791184 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:00.628441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6577af5b-f8e2-48bb-86e7-7367af791184 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:00.690727 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-b07864ec-4c4b-4ac2-a011-26bf29bc0885 req-318dd378-4d31-4f2b-bed0-636a3f125d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0787959c-f72a-4c43-9d8e-99727c31a00e", "name": "network-vif-plugged", "status": "completed", "tag": "48e38ca1-0978-43a8-a28f-176c07485795"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:00.711069 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-b07864ec-4c4b-4ac2-a011-26bf29bc0885 req-318dd378-4d31-4f2b-bed0-636a3f125d28 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:00.711557 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-b07864ec-4c4b-4ac2-a011-26bf29bc0885 req-318dd378-4d31-4f2b-bed0-636a3f125d28 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:00.711993 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-b07864ec-4c4b-4ac2-a011-26bf29bc0885 req-318dd378-4d31-4f2b-bed0-636a3f125d28 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:00.732189 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-b07864ec-4c4b-4ac2-a011-26bf29bc0885 req-318dd378-4d31-4f2b-bed0-636a3f125d28 service nova] Creating event network-vif-plugged:48e38ca1-0978-43a8-a28f-176c07485795 for instance 0787959c-f72a-4c43-9d8e-99727c31a00e on hv-cinder-86213 Oct 20 13:38:00.754591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-b07864ec-4c4b-4ac2-a011-26bf29bc0885 req-318dd378-4d31-4f2b-bed0-636a3f125d28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069573 Oct 20 13:38:00.756296 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 165/316] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:38:00.883157 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6577af5b-f8e2-48bb-86e7-7367af791184 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:00.891033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-6577af5b-f8e2-48bb-86e7-7367af791184 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.301440 Oct 20 13:38:00.891814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 152/317] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:00 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:01.375341 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:01.377264 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:01.382806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2d937186-bf8e-49c5-97f1-6883987650bc tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:01.383990 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2d937186-bf8e-49c5-97f1-6883987650bc tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:01.387423 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:01.388036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:01.388575 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:01.389711 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:01.391026 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:01.392057 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:01.393073 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d937186-bf8e-49c5-97f1-6883987650bc tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:01.393720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d937186-bf8e-49c5-97f1-6883987650bc tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:01.394322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d937186-bf8e-49c5-97f1-6883987650bc tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:01.395302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d937186-bf8e-49c5-97f1-6883987650bc tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:01.395903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d937186-bf8e-49c5-97f1-6883987650bc tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:01.396475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d937186-bf8e-49c5-97f1-6883987650bc tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:01.502006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2d937186-bf8e-49c5-97f1-6883987650bc tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:01.527855 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2d937186-bf8e-49c5-97f1-6883987650bc tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1137 microversion: 2.1 time: 0.149052 Oct 20 13:38:01.536857 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 153/318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:01 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1137 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:01.619001 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:01.619992 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-516ac2fa-5cab-4ee5-b4dc-06d97e2d78ef tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:01.620604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-516ac2fa-5cab-4ee5-b4dc-06d97e2d78ef tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:01.628558 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-516ac2fa-5cab-4ee5-b4dc-06d97e2d78ef tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:01.629026 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-516ac2fa-5cab-4ee5-b4dc-06d97e2d78ef tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:01.629474 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-516ac2fa-5cab-4ee5-b4dc-06d97e2d78ef tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:01.630098 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-516ac2fa-5cab-4ee5-b4dc-06d97e2d78ef tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:01.630538 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-516ac2fa-5cab-4ee5-b4dc-06d97e2d78ef tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:01.630958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-516ac2fa-5cab-4ee5-b4dc-06d97e2d78ef tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:01.633501 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:01.635022 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:01.636728 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-c69c1f74-f8ce-452b-8b1f-a143051f0ead tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1738 microversion: 2.20 time: 0.266107 Oct 20 13:38:01.637340 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 166/319] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:01 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:01.783336 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-516ac2fa-5cab-4ee5-b4dc-06d97e2d78ef tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:01.791831 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-516ac2fa-5cab-4ee5-b4dc-06d97e2d78ef tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.175517 Oct 20 13:38:01.792330 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 154/320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:01 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:01.915269 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d55e8634-744d-4ec4-935b-7ba8ee641059 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:01.916060 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d55e8634-744d-4ec4-935b-7ba8ee641059 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:01.924939 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d55e8634-744d-4ec4-935b-7ba8ee641059 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:01.925436 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d55e8634-744d-4ec4-935b-7ba8ee641059 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:01.925873 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d55e8634-744d-4ec4-935b-7ba8ee641059 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:01.926574 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d55e8634-744d-4ec4-935b-7ba8ee641059 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:01.927033 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d55e8634-744d-4ec4-935b-7ba8ee641059 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:01.927456 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d55e8634-744d-4ec4-935b-7ba8ee641059 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:02.107191 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d55e8634-744d-4ec4-935b-7ba8ee641059 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:02.115317 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d55e8634-744d-4ec4-935b-7ba8ee641059 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1522 microversion: 2.1 time: 0.204119 Oct 20 13:38:02.116154 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 167/321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:01 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:02.559801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-78fc634c-99d0-4e06-a0d5-695ad4055d40 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:02.560448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-78fc634c-99d0-4e06-a0d5-695ad4055d40 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:02.568287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-78fc634c-99d0-4e06-a0d5-695ad4055d40 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:02.568776 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-78fc634c-99d0-4e06-a0d5-695ad4055d40 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:02.569241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-78fc634c-99d0-4e06-a0d5-695ad4055d40 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:02.569945 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-78fc634c-99d0-4e06-a0d5-695ad4055d40 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:02.570399 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-78fc634c-99d0-4e06-a0d5-695ad4055d40 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:02.570819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-78fc634c-99d0-4e06-a0d5-695ad4055d40 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:02.638576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-78fc634c-99d0-4e06-a0d5-695ad4055d40 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:02.646475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-78fc634c-99d0-4e06-a0d5-695ad4055d40 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1193 microversion: 2.1 time: 0.090498 Oct 20 13:38:02.647054 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 155/322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:02 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:02.668086 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:02.668996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:02.676392 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:02.677954 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:02.677954 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:02.678701 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:02.678839 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:02.679221 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:02.814814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-35928fca-4472-47f1-a57c-74b7518926a1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:02.815431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-35928fca-4472-47f1-a57c-74b7518926a1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:02.822612 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35928fca-4472-47f1-a57c-74b7518926a1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:02.823563 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35928fca-4472-47f1-a57c-74b7518926a1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:02.824063 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35928fca-4472-47f1-a57c-74b7518926a1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:02.824855 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35928fca-4472-47f1-a57c-74b7518926a1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:02.825436 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35928fca-4472-47f1-a57c-74b7518926a1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:02.826066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-35928fca-4472-47f1-a57c-74b7518926a1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:02.833159 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:02.842226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:02.844017 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:02.845213 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e1fcbcac-2c97-4db5-b70f-4a1e651f1508 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1738 microversion: 2.20 time: 0.182098 Oct 20 13:38:02.863981 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 168/323] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:02 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:02.970832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-35928fca-4472-47f1-a57c-74b7518926a1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:02.974563 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=100 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:02.980221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-35928fca-4472-47f1-a57c-74b7518926a1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.169387 Oct 20 13:38:02.980903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 156/324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:02 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:03.142020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-901704b2-86b3-447d-8cd5-a6d36f9453ed tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:03.142938 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-901704b2-86b3-447d-8cd5-a6d36f9453ed tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:03.149632 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-901704b2-86b3-447d-8cd5-a6d36f9453ed tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:03.150366 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-901704b2-86b3-447d-8cd5-a6d36f9453ed tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:03.151035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-901704b2-86b3-447d-8cd5-a6d36f9453ed tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:03.151745 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-901704b2-86b3-447d-8cd5-a6d36f9453ed tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:03.152281 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-901704b2-86b3-447d-8cd5-a6d36f9453ed tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:03.152768 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-901704b2-86b3-447d-8cd5-a6d36f9453ed tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:03.302687 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-901704b2-86b3-447d-8cd5-a6d36f9453ed tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:03.316304 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-901704b2-86b3-447d-8cd5-a6d36f9453ed tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1502 microversion: 2.1 time: 0.178243 Oct 20 13:38:03.329449 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 169/325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:03 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:03.373551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9642ebae-288a-48c7-9dea-100fe1e8b165 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:03.378056 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9642ebae-288a-48c7-9dea-100fe1e8b165 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:03.386034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9642ebae-288a-48c7-9dea-100fe1e8b165 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:03.386554 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9642ebae-288a-48c7-9dea-100fe1e8b165 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:03.387034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9642ebae-288a-48c7-9dea-100fe1e8b165 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:03.387774 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9642ebae-288a-48c7-9dea-100fe1e8b165 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:03.388255 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9642ebae-288a-48c7-9dea-100fe1e8b165 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:03.388704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9642ebae-288a-48c7-9dea-100fe1e8b165 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:03.537417 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9642ebae-288a-48c7-9dea-100fe1e8b165 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:03.545384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9642ebae-288a-48c7-9dea-100fe1e8b165 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1516 microversion: 2.1 time: 0.187736 Oct 20 13:38:03.545954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 157/326] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:03 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:03.672903 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-cb84df59-963f-4249-98b6-fb65f35ad6e7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:03.673514 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-cb84df59-963f-4249-98b6-fb65f35ad6e7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:03.679618 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cb84df59-963f-4249-98b6-fb65f35ad6e7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:03.680035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cb84df59-963f-4249-98b6-fb65f35ad6e7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:03.680460 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cb84df59-963f-4249-98b6-fb65f35ad6e7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:03.681285 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cb84df59-963f-4249-98b6-fb65f35ad6e7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:03.681616 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cb84df59-963f-4249-98b6-fb65f35ad6e7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:03.682036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cb84df59-963f-4249-98b6-fb65f35ad6e7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:03.765296 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-cb84df59-963f-4249-98b6-fb65f35ad6e7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:03.773865 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-cb84df59-963f-4249-98b6-fb65f35ad6e7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1193 microversion: 2.1 time: 0.104761 Oct 20 13:38:03.775035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 170/327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:03 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1193 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:03.874941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:03.876170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:03.889262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:03.889262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:03.889262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:03.889262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:03.889558 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:03.889558 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:04.004250 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d923f9e2-b60c-4325-857f-1193efb91ec1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:04.004856 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d923f9e2-b60c-4325-857f-1193efb91ec1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:04.016642 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d923f9e2-b60c-4325-857f-1193efb91ec1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:04.021128 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d923f9e2-b60c-4325-857f-1193efb91ec1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:04.021679 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d923f9e2-b60c-4325-857f-1193efb91ec1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:04.022613 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d923f9e2-b60c-4325-857f-1193efb91ec1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:04.024421 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d923f9e2-b60c-4325-857f-1193efb91ec1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:04.028427 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d923f9e2-b60c-4325-857f-1193efb91ec1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:04.066380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:04.075877 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:04.077442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:04.079461 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e61949ff-da25-4b73-92db-093484c59025 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1738 microversion: 2.20 time: 0.210887 Oct 20 13:38:04.080016 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 158/328] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:03 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:04.213662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d923f9e2-b60c-4325-857f-1193efb91ec1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:04.218024 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=100 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:04.224343 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d923f9e2-b60c-4325-857f-1193efb91ec1 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1318 microversion: 2.1 time: 0.225190 Oct 20 13:38:04.240916 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 171/329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:03 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:04.800404 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-485421f5-5a4e-4307-8425-a9f84b87bca0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:04.801565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-485421f5-5a4e-4307-8425-a9f84b87bca0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:04.809083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-485421f5-5a4e-4307-8425-a9f84b87bca0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:04.809925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-485421f5-5a4e-4307-8425-a9f84b87bca0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:04.810593 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-485421f5-5a4e-4307-8425-a9f84b87bca0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:04.811655 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-485421f5-5a4e-4307-8425-a9f84b87bca0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:04.813022 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-485421f5-5a4e-4307-8425-a9f84b87bca0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:04.813652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-485421f5-5a4e-4307-8425-a9f84b87bca0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:04.905351 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-485421f5-5a4e-4307-8425-a9f84b87bca0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:04.914394 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-485421f5-5a4e-4307-8425-a9f84b87bca0 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1211 microversion: 2.1 time: 0.119131 Oct 20 13:38:04.915472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 159/330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:04 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:05.061438 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-ea335c57-b613-47e6-bcc6-2ecb3f008549 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:05.066136 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-ea335c57-b613-47e6-bcc6-2ecb3f008549 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:05.073973 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ea335c57-b613-47e6-bcc6-2ecb3f008549 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:05.074705 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ea335c57-b613-47e6-bcc6-2ecb3f008549 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:05.075390 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ea335c57-b613-47e6-bcc6-2ecb3f008549 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:05.076736 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ea335c57-b613-47e6-bcc6-2ecb3f008549 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:05.077365 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ea335c57-b613-47e6-bcc6-2ecb3f008549 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:05.078741 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ea335c57-b613-47e6-bcc6-2ecb3f008549 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:05.108099 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:05.109084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:05.115287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:05.121697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:05.122377 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:05.123100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:05.123733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:05.124162 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:05.127479 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.objects.instance [None req-ea335c57-b613-47e6-bcc6-2ecb3f008549 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lazy-loading 'flavor' on Instance uuid 81af22d4-c2fa-4c17-9ab2-8cd63758321a {{(pid=125447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:38:05.349451 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-ea335c57-b613-47e6-bcc6-2ecb3f008549 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a/action" status: 200 len: 32 microversion: 2.1 time: 0.294326 Oct 20 13:38:05.355890 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 172/331] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:38:05 2022] POST /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a/action => generated 32 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 13:38:05.369323 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-8d64b386-69dd-466e-b06c-b2614090449b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:05.370370 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-8d64b386-69dd-466e-b06c-b2614090449b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:05.378797 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8d64b386-69dd-466e-b06c-b2614090449b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:05.379556 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8d64b386-69dd-466e-b06c-b2614090449b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:05.380154 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8d64b386-69dd-466e-b06c-b2614090449b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:05.381055 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8d64b386-69dd-466e-b06c-b2614090449b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:05.381652 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8d64b386-69dd-466e-b06c-b2614090449b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:05.382223 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8d64b386-69dd-466e-b06c-b2614090449b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:05.558721 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:05.565910 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-8d64b386-69dd-466e-b06c-b2614090449b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:05.567839 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:05.569323 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:05.570478 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-728eb7d2-fb6d-4607-affb-d596db6714c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1738 microversion: 2.20 time: 0.466642 Oct 20 13:38:05.578293 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-8d64b386-69dd-466e-b06c-b2614090449b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1507 microversion: 2.1 time: 0.219087 Oct 20 13:38:05.579318 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 173/332] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:05 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:05.584730 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3f0f6ce2-607c-447a-a4d5-22ca93769b3a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:05.585656 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3f0f6ce2-607c-447a-a4d5-22ca93769b3a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:05.592300 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3f0f6ce2-607c-447a-a4d5-22ca93769b3a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:05.593107 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3f0f6ce2-607c-447a-a4d5-22ca93769b3a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:05.595016 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3f0f6ce2-607c-447a-a4d5-22ca93769b3a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:05.596368 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3f0f6ce2-607c-447a-a4d5-22ca93769b3a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:05.598278 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3f0f6ce2-607c-447a-a4d5-22ca93769b3a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:05.599037 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3f0f6ce2-607c-447a-a4d5-22ca93769b3a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:05.599373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 160/333] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:05 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1738 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:05.772078 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3f0f6ce2-607c-447a-a4d5-22ca93769b3a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:05.785397 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3f0f6ce2-607c-447a-a4d5-22ca93769b3a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.204674 Oct 20 13:38:05.786008 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 174/334] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:05 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:05.940380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4515921f-0783-4a16-825e-4f10ca442368 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:05.941847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4515921f-0783-4a16-825e-4f10ca442368 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:05.950849 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4515921f-0783-4a16-825e-4f10ca442368 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:05.951388 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4515921f-0783-4a16-825e-4f10ca442368 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:05.951828 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4515921f-0783-4a16-825e-4f10ca442368 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:05.952573 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4515921f-0783-4a16-825e-4f10ca442368 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:05.954846 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4515921f-0783-4a16-825e-4f10ca442368 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:05.956278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4515921f-0783-4a16-825e-4f10ca442368 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:06.538140 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4515921f-0783-4a16-825e-4f10ca442368 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:06.548068 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4515921f-0783-4a16-825e-4f10ca442368 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.611961 Oct 20 13:38:06.549102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 161/335] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:05 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:06.606625 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:06.607216 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:06.617296 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:06.618488 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:06.621139 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:06.621859 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:06.622320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:06.622752 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:06.819505 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3ee9f37c-8c74-4c55-b639-67800a91da2b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:06.820145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3ee9f37c-8c74-4c55-b639-67800a91da2b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:06.826771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ee9f37c-8c74-4c55-b639-67800a91da2b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:06.828048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ee9f37c-8c74-4c55-b639-67800a91da2b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:06.828666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ee9f37c-8c74-4c55-b639-67800a91da2b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:06.829625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ee9f37c-8c74-4c55-b639-67800a91da2b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:06.830236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ee9f37c-8c74-4c55-b639-67800a91da2b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:06.830817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ee9f37c-8c74-4c55-b639-67800a91da2b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:06.931730 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:06.945692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:06.947538 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:06.949379 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-bb16f0ec-9afc-4853-aaf9-3100fca7ccea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1738 microversion: 2.20 time: 0.346601 Oct 20 13:38:06.975419 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 175/336] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:06 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1738 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:07.126286 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-0bb7be1a-dfa2-4492-b720-67f369aa95bb req-a70b8017-7738-4893-b46d-cf77e006ab54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a95c3c3-dcce-457b-98df-7b6ff3df8680", "tag": "819ed6f1-641c-46ab-baf3-306b4b54da88"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:07.127475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3ee9f37c-8c74-4c55-b639-67800a91da2b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:07.146588 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3ee9f37c-8c74-4c55-b639-67800a91da2b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.338917 Oct 20 13:38:07.147814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 162/337] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:06 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:07.170461 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-0bb7be1a-dfa2-4492-b720-67f369aa95bb req-a70b8017-7738-4893-b46d-cf77e006ab54 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:07.177081 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-0bb7be1a-dfa2-4492-b720-67f369aa95bb req-a70b8017-7738-4893-b46d-cf77e006ab54 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:07.179000 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-0bb7be1a-dfa2-4492-b720-67f369aa95bb req-a70b8017-7738-4893-b46d-cf77e006ab54 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:07.201349 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-0bb7be1a-dfa2-4492-b720-67f369aa95bb req-a70b8017-7738-4893-b46d-cf77e006ab54 service nova] Creating event network-changed:819ed6f1-641c-46ab-baf3-306b4b54da88 for instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 on hv-cinder-86213 Oct 20 13:38:07.216505 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-0bb7be1a-dfa2-4492-b720-67f369aa95bb req-a70b8017-7738-4893-b46d-cf77e006ab54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097020 Oct 20 13:38:07.217365 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 176/338] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:38:07.571932 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b971fe05-bb5d-4f21-b6f0-f556df717793 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:07.572567 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b971fe05-bb5d-4f21-b6f0-f556df717793 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:07.578520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b971fe05-bb5d-4f21-b6f0-f556df717793 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:07.579017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b971fe05-bb5d-4f21-b6f0-f556df717793 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:07.579442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b971fe05-bb5d-4f21-b6f0-f556df717793 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:07.580123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b971fe05-bb5d-4f21-b6f0-f556df717793 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:07.580569 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b971fe05-bb5d-4f21-b6f0-f556df717793 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:07.581016 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b971fe05-bb5d-4f21-b6f0-f556df717793 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:07.712022 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b971fe05-bb5d-4f21-b6f0-f556df717793 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:07.719861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b971fe05-bb5d-4f21-b6f0-f556df717793 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.151790 Oct 20 13:38:07.720427 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 163/339] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:07 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:07.976695 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:07.977326 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:07.983478 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:07.984611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:07.985065 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:07.985742 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:07.986185 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:07.986600 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:08.119689 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:08.128294 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:08.129847 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:08.131034 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-8cee3072-0ff9-4ceb-b11b-fb41c75993c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1738 microversion: 2.20 time: 0.159176 Oct 20 13:38:08.131604 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 177/340] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:07 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:08.172704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2a5265a6-9d44-4216-9b28-1178c1238032 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:08.173654 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2a5265a6-9d44-4216-9b28-1178c1238032 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:08.180542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a5265a6-9d44-4216-9b28-1178c1238032 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:08.181071 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a5265a6-9d44-4216-9b28-1178c1238032 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:08.181503 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a5265a6-9d44-4216-9b28-1178c1238032 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:08.182192 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a5265a6-9d44-4216-9b28-1178c1238032 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:08.182642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a5265a6-9d44-4216-9b28-1178c1238032 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:08.183060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a5265a6-9d44-4216-9b28-1178c1238032 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:08.312208 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2a5265a6-9d44-4216-9b28-1178c1238032 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:08.320567 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2a5265a6-9d44-4216-9b28-1178c1238032 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.152696 Oct 20 13:38:08.321575 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 164/341] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:08 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:08.743075 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-de49b6ba-d551-453a-97e4-0c2100dac363 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:08.743694 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-de49b6ba-d551-453a-97e4-0c2100dac363 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:08.749583 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-de49b6ba-d551-453a-97e4-0c2100dac363 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:08.750069 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-de49b6ba-d551-453a-97e4-0c2100dac363 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:08.750515 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-de49b6ba-d551-453a-97e4-0c2100dac363 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:08.751465 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-de49b6ba-d551-453a-97e4-0c2100dac363 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:08.751918 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-de49b6ba-d551-453a-97e4-0c2100dac363 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:08.752345 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-de49b6ba-d551-453a-97e4-0c2100dac363 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:08.889499 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-de49b6ba-d551-453a-97e4-0c2100dac363 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:08.897435 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-de49b6ba-d551-453a-97e4-0c2100dac363 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.158332 Oct 20 13:38:08.898181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 178/342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:08 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:09.155737 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:09.156344 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:09.163497 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:09.163979 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:09.164412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:09.165125 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:09.165594 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:09.166003 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:09.345590 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b01d7a53-428a-479e-a9e8-b99a8d03806c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:09.346269 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b01d7a53-428a-479e-a9e8-b99a8d03806c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:09.353198 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b01d7a53-428a-479e-a9e8-b99a8d03806c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:09.354106 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b01d7a53-428a-479e-a9e8-b99a8d03806c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:09.354469 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b01d7a53-428a-479e-a9e8-b99a8d03806c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:09.355247 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b01d7a53-428a-479e-a9e8-b99a8d03806c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:09.355731 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b01d7a53-428a-479e-a9e8-b99a8d03806c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:09.356222 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b01d7a53-428a-479e-a9e8-b99a8d03806c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:09.448422 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:09.459120 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:09.460583 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:09.461759 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-18c558c7-05f1-48e9-b5e7-1bcf188f0f7f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1720 microversion: 2.20 time: 0.309950 Oct 20 13:38:09.462316 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 165/343] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:09 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1720 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:09.515720 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b01d7a53-428a-479e-a9e8-b99a8d03806c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:09.524114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b01d7a53-428a-479e-a9e8-b99a8d03806c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.183334 Oct 20 13:38:09.524666 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 179/344] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:09 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:09.921295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d094918f-0ccc-4047-a46c-d184aa88129c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:09.921903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d094918f-0ccc-4047-a46c-d184aa88129c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:09.924706 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=100 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:09.930218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d094918f-0ccc-4047-a46c-d184aa88129c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:09.930704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d094918f-0ccc-4047-a46c-d184aa88129c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:09.931131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d094918f-0ccc-4047-a46c-d184aa88129c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:09.931826 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d094918f-0ccc-4047-a46c-d184aa88129c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:09.932275 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d094918f-0ccc-4047-a46c-d184aa88129c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:09.932696 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d094918f-0ccc-4047-a46c-d184aa88129c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:10.063372 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d094918f-0ccc-4047-a46c-d184aa88129c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:10.071627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d094918f-0ccc-4047-a46c-d184aa88129c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.154019 Oct 20 13:38:10.072207 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 166/345] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:09 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:10.487979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:10.488586 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:10.490599 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=2 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:10.491394 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=8 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:10.497405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:10.497892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:10.498327 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:10.499025 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:10.499475 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:10.499896 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:10.547217 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-57611012-f71c-4abe-a05e-30d3aa024f2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:10.547881 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-57611012-f71c-4abe-a05e-30d3aa024f2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:10.554565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57611012-f71c-4abe-a05e-30d3aa024f2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:10.555045 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57611012-f71c-4abe-a05e-30d3aa024f2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:10.555478 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57611012-f71c-4abe-a05e-30d3aa024f2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:10.556162 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57611012-f71c-4abe-a05e-30d3aa024f2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:10.556609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57611012-f71c-4abe-a05e-30d3aa024f2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:10.557057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57611012-f71c-4abe-a05e-30d3aa024f2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:10.644668 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:10.653175 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:10.654731 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:10.656013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-f6f3fa41-0ff6-4591-8320-80c02fb118ea tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1720 microversion: 2.20 time: 0.172375 Oct 20 13:38:10.667738 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 180/346] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:10 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:10.700978 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-57611012-f71c-4abe-a05e-30d3aa024f2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:10.709866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-57611012-f71c-4abe-a05e-30d3aa024f2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.166531 Oct 20 13:38:10.710446 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 167/347] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:10 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:11.094709 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3a019570-a472-485a-bc97-7116a351560c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:11.095364 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3a019570-a472-485a-bc97-7116a351560c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:11.101428 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3a019570-a472-485a-bc97-7116a351560c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:11.101907 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3a019570-a472-485a-bc97-7116a351560c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:11.102339 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3a019570-a472-485a-bc97-7116a351560c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:11.103016 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3a019570-a472-485a-bc97-7116a351560c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:11.103469 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3a019570-a472-485a-bc97-7116a351560c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:11.103887 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3a019570-a472-485a-bc97-7116a351560c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:11.233958 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3a019570-a472-485a-bc97-7116a351560c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:11.242467 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3a019570-a472-485a-bc97-7116a351560c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.151583 Oct 20 13:38:11.243036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 181/348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:11 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:11.682029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:11.682665 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:11.689299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:11.689964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:11.690404 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:11.691120 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:11.691568 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:11.691989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:11.744961 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7cd65fba-3f63-4890-816c-7b58329fb917 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:11.746039 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7cd65fba-3f63-4890-816c-7b58329fb917 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:11.756697 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7cd65fba-3f63-4890-816c-7b58329fb917 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:11.757392 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7cd65fba-3f63-4890-816c-7b58329fb917 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:11.758270 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7cd65fba-3f63-4890-816c-7b58329fb917 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:11.759134 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7cd65fba-3f63-4890-816c-7b58329fb917 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:11.759802 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7cd65fba-3f63-4890-816c-7b58329fb917 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:11.760536 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7cd65fba-3f63-4890-816c-7b58329fb917 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:11.833770 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:11.841855 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:11.843293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:11.844456 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3971078e-d396-417e-9ea0-c70e078e5307 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1723 microversion: 2.20 time: 0.166320 Oct 20 13:38:11.845032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 168/349] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:11 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:11.871753 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1e485c0c-cd6f-4e0a-9963-12599e833e9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6148b8e8-406a-40e9-b8f0-8355aa31b06f"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:11.874442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1e485c0c-cd6f-4e0a-9963-12599e833e9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:11.881093 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e485c0c-cd6f-4e0a-9963-12599e833e9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:11.881579 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e485c0c-cd6f-4e0a-9963-12599e833e9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:11.882006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e485c0c-cd6f-4e0a-9963-12599e833e9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:11.882699 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e485c0c-cd6f-4e0a-9963-12599e833e9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:11.883152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e485c0c-cd6f-4e0a-9963-12599e833e9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:11.883576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e485c0c-cd6f-4e0a-9963-12599e833e9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:11.918906 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7cd65fba-3f63-4890-816c-7b58329fb917 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:11.929481 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7cd65fba-3f63-4890-816c-7b58329fb917 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.197724 Oct 20 13:38:11.933067 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 182/350] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:11 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:12.182469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1e485c0c-cd6f-4e0a-9963-12599e833e9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "POST /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315749 Oct 20 13:38:12.183066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 169/351] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Oct 20 13:38:11 2022] POST /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 13:38:12.266788 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f1e107c6-6f5a-45a8-9bff-1505728585de tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:12.268851 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-f1e107c6-6f5a-45a8-9bff-1505728585de tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:12.275533 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1e107c6-6f5a-45a8-9bff-1505728585de tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:12.279694 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1e107c6-6f5a-45a8-9bff-1505728585de tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:12.279694 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1e107c6-6f5a-45a8-9bff-1505728585de tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:12.279694 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1e107c6-6f5a-45a8-9bff-1505728585de tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:12.279694 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1e107c6-6f5a-45a8-9bff-1505728585de tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:12.280129 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1e107c6-6f5a-45a8-9bff-1505728585de tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:12.333422 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3c249744-d40f-4e08-81a1-c086da5eb0d3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:12.334273 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3c249744-d40f-4e08-81a1-c086da5eb0d3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:12.341251 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c249744-d40f-4e08-81a1-c086da5eb0d3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:12.342105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c249744-d40f-4e08-81a1-c086da5eb0d3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:12.342461 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c249744-d40f-4e08-81a1-c086da5eb0d3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:12.343502 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c249744-d40f-4e08-81a1-c086da5eb0d3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:12.344097 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c249744-d40f-4e08-81a1-c086da5eb0d3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:12.344687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c249744-d40f-4e08-81a1-c086da5eb0d3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:12.410688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3c249744-d40f-4e08-81a1-c086da5eb0d3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125448) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 20 13:38:12.440453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:12.444069 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-f1e107c6-6f5a-45a8-9bff-1505728585de tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:12.453225 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-f1e107c6-6f5a-45a8-9bff-1505728585de tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.189985 Oct 20 13:38:12.453860 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 183/352] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:12 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:12.459500 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-37ec44ad-4fce-4ef3-acc9-4e72fae8c659 req-4529bc10-8af3-4411-a1cb-7f4eb96c564f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b9ae5b-1e55-409f-9a61-b1e2a47d1b58", "name": "network-vif-unplugged", "status": "completed", "tag": "c4329cd6-ac99-4465-b271-c87f6eb593c4"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:12.469998 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-37ec44ad-4fce-4ef3-acc9-4e72fae8c659 req-4529bc10-8af3-4411-a1cb-7f4eb96c564f service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:12.470862 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-37ec44ad-4fce-4ef3-acc9-4e72fae8c659 req-4529bc10-8af3-4411-a1cb-7f4eb96c564f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:12.471976 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-37ec44ad-4fce-4ef3-acc9-4e72fae8c659 req-4529bc10-8af3-4411-a1cb-7f4eb96c564f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:12.484121 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.compute.server_external_events [req-37ec44ad-4fce-4ef3-acc9-4e72fae8c659 req-4529bc10-8af3-4411-a1cb-7f4eb96c564f service nova] Unable to find a host for instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58. Dropping event network-vif-unplugged {{(pid=125447) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 20 13:38:12.485111 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-37ec44ad-4fce-4ef3-acc9-4e72fae8c659 req-4529bc10-8af3-4411-a1cb-7f4eb96c564f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029234 Oct 20 13:38:12.486966 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 184/353] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 20 13:38:12.494157 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3c249744-d40f-4e08-81a1-c086da5eb0d3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "POST /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/action" status: 202 len: 0 microversion: 2.20 time: 0.174868 Oct 20 13:38:12.494787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 170/354] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 20 13:38:12 2022] POST /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 20 13:38:12.504819 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:12.505398 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:12.511409 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:12.512794 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:12.513281 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:12.513990 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:12.514446 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:12.514894 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:12.656022 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:12.666817 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:12.669010 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:12.670195 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e8c53f64-3225-44c9-8f86-2d665cd640fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1749 microversion: 2.20 time: 0.171353 Oct 20 13:38:12.670920 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 185/355] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:12 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:12.952654 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f4ab078d-8932-446b-bc43-59c30a58602f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:12.953298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f4ab078d-8932-446b-bc43-59c30a58602f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:12.959759 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4ab078d-8932-446b-bc43-59c30a58602f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:12.960237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4ab078d-8932-446b-bc43-59c30a58602f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:12.960684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4ab078d-8932-446b-bc43-59c30a58602f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:12.961399 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4ab078d-8932-446b-bc43-59c30a58602f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:12.961846 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4ab078d-8932-446b-bc43-59c30a58602f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:12.962259 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4ab078d-8932-446b-bc43-59c30a58602f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:13.099337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f4ab078d-8932-446b-bc43-59c30a58602f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:13.107383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f4ab078d-8932-446b-bc43-59c30a58602f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.158547 Oct 20 13:38:13.107955 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 171/356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:12 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:13.478352 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-afb972c2-424b-48f8-92bd-91030d04d2fb tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:13.479136 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-afb972c2-424b-48f8-92bd-91030d04d2fb tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:13.486399 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-afb972c2-424b-48f8-92bd-91030d04d2fb tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:13.487187 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-afb972c2-424b-48f8-92bd-91030d04d2fb tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:13.487613 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-afb972c2-424b-48f8-92bd-91030d04d2fb tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:13.488341 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-afb972c2-424b-48f8-92bd-91030d04d2fb tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:13.488978 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-afb972c2-424b-48f8-92bd-91030d04d2fb tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:13.489521 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-afb972c2-424b-48f8-92bd-91030d04d2fb tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:13.624679 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-afb972c2-424b-48f8-92bd-91030d04d2fb tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:13.633502 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-afb972c2-424b-48f8-92bd-91030d04d2fb tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.159557 Oct 20 13:38:13.634071 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 186/357] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:13 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:13.696527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:13.697191 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:13.703189 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:13.703672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:13.704105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:13.704790 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:13.705270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:13.705693 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:13.836111 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:13.844587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:13.846935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:13.848077 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9f08be28-cbdf-4d09-a473-1508831236ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1751 microversion: 2.20 time: 0.155484 Oct 20 13:38:13.848736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 172/358] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:13 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:14.131662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5c1160b2-40f4-4266-a13c-803a41a9c944 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:14.132182 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5c1160b2-40f4-4266-a13c-803a41a9c944 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:14.138102 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5c1160b2-40f4-4266-a13c-803a41a9c944 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:14.138576 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5c1160b2-40f4-4266-a13c-803a41a9c944 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:14.139004 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5c1160b2-40f4-4266-a13c-803a41a9c944 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:14.139678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5c1160b2-40f4-4266-a13c-803a41a9c944 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:14.140126 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5c1160b2-40f4-4266-a13c-803a41a9c944 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:14.140538 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5c1160b2-40f4-4266-a13c-803a41a9c944 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:14.269941 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5c1160b2-40f4-4266-a13c-803a41a9c944 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:14.273376 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:14.278167 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5c1160b2-40f4-4266-a13c-803a41a9c944 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.150592 Oct 20 13:38:14.278736 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 187/359] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:14 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:14.657108 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-27796db9-7a5e-4965-a695-491653238d7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:14.657823 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-27796db9-7a5e-4965-a695-491653238d7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:14.665509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27796db9-7a5e-4965-a695-491653238d7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:14.666005 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27796db9-7a5e-4965-a695-491653238d7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:14.666470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27796db9-7a5e-4965-a695-491653238d7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:14.667174 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27796db9-7a5e-4965-a695-491653238d7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:14.667628 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27796db9-7a5e-4965-a695-491653238d7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:14.668157 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27796db9-7a5e-4965-a695-491653238d7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:14.807759 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-27796db9-7a5e-4965-a695-491653238d7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:14.816648 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-27796db9-7a5e-4965-a695-491653238d7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.163427 Oct 20 13:38:14.817592 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 173/360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:14 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:14.874973 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:14.875839 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:14.884345 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:14.884818 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:14.885330 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:14.886007 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:14.886453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:14.886924 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:15.019826 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:15.028236 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:15.029733 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:15.030876 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3b8bf53c-e408-4f0d-bcc2-83ace0ab881d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1751 microversion: 2.20 time: 0.159877 Oct 20 13:38:15.031429 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 188/361] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:14 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:15.302411 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3d3c597f-58a2-429d-a51d-f51bc68e960b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:15.303129 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3d3c597f-58a2-429d-a51d-f51bc68e960b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:15.309592 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d3c597f-58a2-429d-a51d-f51bc68e960b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:15.310072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d3c597f-58a2-429d-a51d-f51bc68e960b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:15.310508 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d3c597f-58a2-429d-a51d-f51bc68e960b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:15.311192 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d3c597f-58a2-429d-a51d-f51bc68e960b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:15.311641 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d3c597f-58a2-429d-a51d-f51bc68e960b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:15.312058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d3c597f-58a2-429d-a51d-f51bc68e960b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:15.454551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3d3c597f-58a2-429d-a51d-f51bc68e960b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:15.462662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3d3c597f-58a2-429d-a51d-f51bc68e960b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.164945 Oct 20 13:38:15.463333 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 174/362] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:15 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:15.841262 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d68f8403-5d1e-4bb4-b7bc-d00e38cd9c7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:15.841790 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d68f8403-5d1e-4bb4-b7bc-d00e38cd9c7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:15.847993 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d68f8403-5d1e-4bb4-b7bc-d00e38cd9c7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:15.848483 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d68f8403-5d1e-4bb4-b7bc-d00e38cd9c7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:15.848947 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d68f8403-5d1e-4bb4-b7bc-d00e38cd9c7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:15.849645 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d68f8403-5d1e-4bb4-b7bc-d00e38cd9c7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:15.850102 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d68f8403-5d1e-4bb4-b7bc-d00e38cd9c7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:15.850562 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d68f8403-5d1e-4bb4-b7bc-d00e38cd9c7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:15.979780 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d68f8403-5d1e-4bb4-b7bc-d00e38cd9c7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:15.988148 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d68f8403-5d1e-4bb4-b7bc-d00e38cd9c7e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.150734 Oct 20 13:38:15.988698 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 189/363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:15 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:16.057494 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:16.058100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:16.064421 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:16.065008 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:16.065590 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:16.066278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:16.066727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:16.067145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:16.195828 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:16.204294 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:16.205763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:16.206902 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3448ae64-b457-436e-b66f-d64e6d8d417c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.153314 Oct 20 13:38:16.207457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 175/364] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:16 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:16.489603 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-da469f26-5c96-41e6-8fb8-0b0535ce6274 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:16.490377 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-da469f26-5c96-41e6-8fb8-0b0535ce6274 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:16.496435 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-da469f26-5c96-41e6-8fb8-0b0535ce6274 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:16.497138 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-da469f26-5c96-41e6-8fb8-0b0535ce6274 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:16.497568 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-da469f26-5c96-41e6-8fb8-0b0535ce6274 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:16.498428 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-da469f26-5c96-41e6-8fb8-0b0535ce6274 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:16.498883 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-da469f26-5c96-41e6-8fb8-0b0535ce6274 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:16.499296 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-da469f26-5c96-41e6-8fb8-0b0535ce6274 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:16.650992 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-da469f26-5c96-41e6-8fb8-0b0535ce6274 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:16.659085 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-da469f26-5c96-41e6-8fb8-0b0535ce6274 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.176786 Oct 20 13:38:16.659592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 190/365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:16 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:17.011867 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a3064311-1b77-4f0e-b532-087e9b6ee7cd tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:17.012702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a3064311-1b77-4f0e-b532-087e9b6ee7cd tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:17.019056 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3064311-1b77-4f0e-b532-087e9b6ee7cd tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:17.020237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3064311-1b77-4f0e-b532-087e9b6ee7cd tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:17.020237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3064311-1b77-4f0e-b532-087e9b6ee7cd tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:17.020659 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3064311-1b77-4f0e-b532-087e9b6ee7cd tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:17.021149 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3064311-1b77-4f0e-b532-087e9b6ee7cd tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:17.021576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3064311-1b77-4f0e-b532-087e9b6ee7cd tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:17.170027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a3064311-1b77-4f0e-b532-087e9b6ee7cd tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:17.180087 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a3064311-1b77-4f0e-b532-087e9b6ee7cd tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.172202 Oct 20 13:38:17.180810 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 176/366] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:17 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:17.233342 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:17.234599 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:17.242611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:17.243547 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:17.244228 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:17.245271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:17.245846 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:17.246423 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:17.434475 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:17.445891 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:17.452284 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:17.454803 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7db04e8c-b42b-4cd1-9f3b-714ade6e0c22 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.225325 Oct 20 13:38:17.469337 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 191/367] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:17 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:17.682684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-dc9700ac-5fe9-4456-a68f-9a6993775d99 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:17.683299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-dc9700ac-5fe9-4456-a68f-9a6993775d99 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:17.689408 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc9700ac-5fe9-4456-a68f-9a6993775d99 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:17.690129 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc9700ac-5fe9-4456-a68f-9a6993775d99 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:17.691024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc9700ac-5fe9-4456-a68f-9a6993775d99 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:17.692004 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc9700ac-5fe9-4456-a68f-9a6993775d99 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:17.692666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc9700ac-5fe9-4456-a68f-9a6993775d99 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:17.693269 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc9700ac-5fe9-4456-a68f-9a6993775d99 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:17.841178 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-dc9700ac-5fe9-4456-a68f-9a6993775d99 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:17.858297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-dc9700ac-5fe9-4456-a68f-9a6993775d99 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.179456 Oct 20 13:38:17.859599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 177/368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:17 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:18.204101 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9db69eae-7cfd-44f4-ab7d-67efb17a519d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:18.206983 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9db69eae-7cfd-44f4-ab7d-67efb17a519d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:18.215154 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db69eae-7cfd-44f4-ab7d-67efb17a519d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:18.215981 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db69eae-7cfd-44f4-ab7d-67efb17a519d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:18.216624 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db69eae-7cfd-44f4-ab7d-67efb17a519d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:18.217466 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db69eae-7cfd-44f4-ab7d-67efb17a519d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:18.217995 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db69eae-7cfd-44f4-ab7d-67efb17a519d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:18.218529 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9db69eae-7cfd-44f4-ab7d-67efb17a519d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:18.372492 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9db69eae-7cfd-44f4-ab7d-67efb17a519d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:18.394600 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9db69eae-7cfd-44f4-ab7d-67efb17a519d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.194421 Oct 20 13:38:18.395184 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 192/369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:18 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:18.484091 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:18.484701 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:18.519297 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-0e28df24-bcb9-4d8a-84b7-eda33cc556bb req-97623c4b-c031-4fe5-8cac-b16e2b1e8ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a95c3c3-dcce-457b-98df-7b6ff3df8680", "name": "network-vif-plugged", "status": "completed", "tag": "819ed6f1-641c-46ab-baf3-306b4b54da88"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:18.524075 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:18.524809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:18.525666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:18.526532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:18.527132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:18.527744 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:18.538988 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-0e28df24-bcb9-4d8a-84b7-eda33cc556bb req-97623c4b-c031-4fe5-8cac-b16e2b1e8ab5 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:18.540510 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-0e28df24-bcb9-4d8a-84b7-eda33cc556bb req-97623c4b-c031-4fe5-8cac-b16e2b1e8ab5 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:18.542741 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-0e28df24-bcb9-4d8a-84b7-eda33cc556bb req-97623c4b-c031-4fe5-8cac-b16e2b1e8ab5 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:18.568273 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-0e28df24-bcb9-4d8a-84b7-eda33cc556bb req-97623c4b-c031-4fe5-8cac-b16e2b1e8ab5 service nova] Creating event network-vif-plugged:819ed6f1-641c-46ab-baf3-306b4b54da88 for instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 on hv-cinder-86213 Oct 20 13:38:18.575271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-0e28df24-bcb9-4d8a-84b7-eda33cc556bb req-97623c4b-c031-4fe5-8cac-b16e2b1e8ab5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061817 Oct 20 13:38:18.576750 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 193/370] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:38:18.698588 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:18.709456 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:18.711147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:18.712313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c60d406b-df14-480d-9c03-0a2cc6ce058c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.232632 Oct 20 13:38:18.712948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 178/371] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:18 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:18.889547 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-949b2968-fba9-49c5-a305-0f2b2ce5629c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:18.890265 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-949b2968-fba9-49c5-a305-0f2b2ce5629c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:18.897720 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-949b2968-fba9-49c5-a305-0f2b2ce5629c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:18.898209 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-949b2968-fba9-49c5-a305-0f2b2ce5629c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:18.898642 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-949b2968-fba9-49c5-a305-0f2b2ce5629c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:18.899352 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-949b2968-fba9-49c5-a305-0f2b2ce5629c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:18.899801 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-949b2968-fba9-49c5-a305-0f2b2ce5629c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:18.900223 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-949b2968-fba9-49c5-a305-0f2b2ce5629c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:19.279998 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-949b2968-fba9-49c5-a305-0f2b2ce5629c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:19.288665 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-949b2968-fba9-49c5-a305-0f2b2ce5629c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.404155 Oct 20 13:38:19.289277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 194/372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:18 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:19.418666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4ab7dc1b-4e13-4a64-bed5-b3f49370c3d4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:19.419334 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4ab7dc1b-4e13-4a64-bed5-b3f49370c3d4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:19.426252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ab7dc1b-4e13-4a64-bed5-b3f49370c3d4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:19.426747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ab7dc1b-4e13-4a64-bed5-b3f49370c3d4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:19.427191 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ab7dc1b-4e13-4a64-bed5-b3f49370c3d4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:19.427881 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ab7dc1b-4e13-4a64-bed5-b3f49370c3d4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:19.428337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ab7dc1b-4e13-4a64-bed5-b3f49370c3d4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:19.428760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ab7dc1b-4e13-4a64-bed5-b3f49370c3d4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:19.573197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4ab7dc1b-4e13-4a64-bed5-b3f49370c3d4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:19.581828 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4ab7dc1b-4e13-4a64-bed5-b3f49370c3d4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.167095 Oct 20 13:38:19.582409 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 179/373] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:19 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:19.737725 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:19.738279 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:19.744242 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:19.744720 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:19.745188 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:19.745987 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:19.746442 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:19.746982 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:19.884748 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:19.893940 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:19.895396 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:19.896540 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-ff4edc40-8532-40f2-a3da-652ada7c6f4f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.162899 Oct 20 13:38:19.897154 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 195/374] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:19 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:20.312023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-931af8c7-6b6f-41c5-aa69-55621cd477e6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:20.312629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-931af8c7-6b6f-41c5-aa69-55621cd477e6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:20.319594 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-931af8c7-6b6f-41c5-aa69-55621cd477e6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:20.320076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-931af8c7-6b6f-41c5-aa69-55621cd477e6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:20.320510 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-931af8c7-6b6f-41c5-aa69-55621cd477e6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:20.321308 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-931af8c7-6b6f-41c5-aa69-55621cd477e6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:20.321745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-931af8c7-6b6f-41c5-aa69-55621cd477e6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:20.322166 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-931af8c7-6b6f-41c5-aa69-55621cd477e6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:20.479885 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-931af8c7-6b6f-41c5-aa69-55621cd477e6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:20.488513 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-931af8c7-6b6f-41c5-aa69-55621cd477e6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.180295 Oct 20 13:38:20.489110 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 180/375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:20 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:20.605613 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-8b976a77-9e04-4c8a-a0fb-6e8cbbd9a559 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:20.606328 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-8b976a77-9e04-4c8a-a0fb-6e8cbbd9a559 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:20.614207 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8b976a77-9e04-4c8a-a0fb-6e8cbbd9a559 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:20.614692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8b976a77-9e04-4c8a-a0fb-6e8cbbd9a559 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:20.615133 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8b976a77-9e04-4c8a-a0fb-6e8cbbd9a559 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:20.615858 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8b976a77-9e04-4c8a-a0fb-6e8cbbd9a559 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:20.616314 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8b976a77-9e04-4c8a-a0fb-6e8cbbd9a559 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:20.616772 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8b976a77-9e04-4c8a-a0fb-6e8cbbd9a559 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:20.755045 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-8b976a77-9e04-4c8a-a0fb-6e8cbbd9a559 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:20.762685 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-8b976a77-9e04-4c8a-a0fb-6e8cbbd9a559 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.161144 Oct 20 13:38:20.763253 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 196/376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:20 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:20.923057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:20.923620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:20.930320 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:20.930799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:20.931226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:20.931905 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:20.932353 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:20.932773 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:21.067230 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:21.075900 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:21.077373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:21.078526 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-6de117f3-d89b-413d-bb22-9709732362d4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.159496 Oct 20 13:38:21.079081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 181/377] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:20 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:21.513213 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-dc486e05-f8e7-45c1-9870-2f8f02470ee6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:21.513835 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-dc486e05-f8e7-45c1-9870-2f8f02470ee6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:21.520389 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc486e05-f8e7-45c1-9870-2f8f02470ee6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:21.520888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc486e05-f8e7-45c1-9870-2f8f02470ee6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:21.521327 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc486e05-f8e7-45c1-9870-2f8f02470ee6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:21.522120 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc486e05-f8e7-45c1-9870-2f8f02470ee6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:21.522602 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc486e05-f8e7-45c1-9870-2f8f02470ee6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:21.523023 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc486e05-f8e7-45c1-9870-2f8f02470ee6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:21.663643 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-dc486e05-f8e7-45c1-9870-2f8f02470ee6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:21.672067 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-dc486e05-f8e7-45c1-9870-2f8f02470ee6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.162669 Oct 20 13:38:21.672656 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 197/378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:21 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:21.786062 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8f98a290-e7e5-4344-b642-e2584008d3a7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:21.786665 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8f98a290-e7e5-4344-b642-e2584008d3a7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:21.793039 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f98a290-e7e5-4344-b642-e2584008d3a7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:21.793516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f98a290-e7e5-4344-b642-e2584008d3a7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:21.793940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f98a290-e7e5-4344-b642-e2584008d3a7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:21.794617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f98a290-e7e5-4344-b642-e2584008d3a7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:21.795060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f98a290-e7e5-4344-b642-e2584008d3a7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:21.795474 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f98a290-e7e5-4344-b642-e2584008d3a7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:22.104598 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:22.106131 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:22.123582 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:22.124079 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:22.124715 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:22.125877 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:22.126492 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:22.127666 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:22.165565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8f98a290-e7e5-4344-b642-e2584008d3a7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:22.174846 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8f98a290-e7e5-4344-b642-e2584008d3a7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.393134 Oct 20 13:38:22.175802 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 182/379] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:21 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:22.271928 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:22.280683 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:22.282160 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:22.283847 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d79ac287-bdec-43e3-b202-6459cc1767b3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.182514 Oct 20 13:38:22.284403 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 198/380] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:22 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:22.695698 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-bbf1c8ba-b132-408b-9a0b-7bb499f3f966 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:22.696437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-bbf1c8ba-b132-408b-9a0b-7bb499f3f966 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:22.702452 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bbf1c8ba-b132-408b-9a0b-7bb499f3f966 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:22.702966 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bbf1c8ba-b132-408b-9a0b-7bb499f3f966 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:22.703394 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bbf1c8ba-b132-408b-9a0b-7bb499f3f966 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:22.704074 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bbf1c8ba-b132-408b-9a0b-7bb499f3f966 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:22.704517 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bbf1c8ba-b132-408b-9a0b-7bb499f3f966 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:22.704959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bbf1c8ba-b132-408b-9a0b-7bb499f3f966 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:22.837242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-bbf1c8ba-b132-408b-9a0b-7bb499f3f966 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:22.846138 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-bbf1c8ba-b132-408b-9a0b-7bb499f3f966 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.154144 Oct 20 13:38:22.847814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 183/381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:22 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:23.198684 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5df7c267-2a03-4511-b36d-1b0162c06b1d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:23.199292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5df7c267-2a03-4511-b36d-1b0162c06b1d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:23.205921 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5df7c267-2a03-4511-b36d-1b0162c06b1d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:23.206229 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5df7c267-2a03-4511-b36d-1b0162c06b1d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:23.206655 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5df7c267-2a03-4511-b36d-1b0162c06b1d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:23.207326 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5df7c267-2a03-4511-b36d-1b0162c06b1d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:23.207774 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5df7c267-2a03-4511-b36d-1b0162c06b1d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:23.208188 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5df7c267-2a03-4511-b36d-1b0162c06b1d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:23.310695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:23.311342 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:23.317883 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:23.318366 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:23.318801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:23.319500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:23.319948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:23.320368 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:23.353629 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5df7c267-2a03-4511-b36d-1b0162c06b1d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:23.362182 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5df7c267-2a03-4511-b36d-1b0162c06b1d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.166796 Oct 20 13:38:23.362998 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 199/382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:23 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:23.454297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:23.463907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:23.465628 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:23.466961 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8ffb5d07-3c60-40b1-999b-ac7a4464ceaa tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.160747 Oct 20 13:38:23.467677 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 184/383] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:23 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:23.870639 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-43d19618-3a8d-4b6b-82b7-52285c9bb4d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:23.871248 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-43d19618-3a8d-4b6b-82b7-52285c9bb4d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:23.877690 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-43d19618-3a8d-4b6b-82b7-52285c9bb4d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:23.878264 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-43d19618-3a8d-4b6b-82b7-52285c9bb4d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:23.878597 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-43d19618-3a8d-4b6b-82b7-52285c9bb4d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:23.879300 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-43d19618-3a8d-4b6b-82b7-52285c9bb4d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:23.879759 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-43d19618-3a8d-4b6b-82b7-52285c9bb4d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:23.880205 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-43d19618-3a8d-4b6b-82b7-52285c9bb4d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:24.014540 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-43d19618-3a8d-4b6b-82b7-52285c9bb4d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:24.023430 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-43d19618-3a8d-4b6b-82b7-52285c9bb4d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.156634 Oct 20 13:38:24.024205 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 200/384] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:23 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:24.329003 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4b2503c6-cc8c-4ae2-b18d-45ee672cec5a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "359f5997-8f2c-4cae-8239-88e23b14a10c", "device": "/dev/sdb"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:24.333091 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4b2503c6-cc8c-4ae2-b18d-45ee672cec5a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:24.339609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b2503c6-cc8c-4ae2-b18d-45ee672cec5a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:24.340092 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b2503c6-cc8c-4ae2-b18d-45ee672cec5a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:24.340518 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b2503c6-cc8c-4ae2-b18d-45ee672cec5a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:24.341238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b2503c6-cc8c-4ae2-b18d-45ee672cec5a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:24.341685 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b2503c6-cc8c-4ae2-b18d-45ee672cec5a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:24.342107 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b2503c6-cc8c-4ae2-b18d-45ee672cec5a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:24.386634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5a5bd2a0-6b22-4999-99bc-c7728b91fd57 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:24.387333 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5a5bd2a0-6b22-4999-99bc-c7728b91fd57 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:24.394487 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a5bd2a0-6b22-4999-99bc-c7728b91fd57 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:24.395047 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a5bd2a0-6b22-4999-99bc-c7728b91fd57 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:24.395552 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a5bd2a0-6b22-4999-99bc-c7728b91fd57 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:24.396319 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a5bd2a0-6b22-4999-99bc-c7728b91fd57 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:24.397024 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a5bd2a0-6b22-4999-99bc-c7728b91fd57 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:24.397519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a5bd2a0-6b22-4999-99bc-c7728b91fd57 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:24.532671 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5a5bd2a0-6b22-4999-99bc-c7728b91fd57 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:24.541722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5a5bd2a0-6b22-4999-99bc-c7728b91fd57 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.159212 Oct 20 13:38:24.554263 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 201/385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:24 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:24.554263 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:24.554263 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:24.554263 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:24.556193 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:24.556706 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:24.557290 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:24.558275 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:24.558418 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:24.558834 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:24.711999 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:24.721569 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:24.723278 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:24.724416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-58725661-9c06-4dae-b46c-925632d52fa3 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.181174 Oct 20 13:38:24.724985 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 202/386] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:24 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:25.046754 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-648a2433-4672-4d64-a885-ac67352d1a16 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:25.047357 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-648a2433-4672-4d64-a885-ac67352d1a16 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:25.053408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-648a2433-4672-4d64-a885-ac67352d1a16 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:25.053889 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-648a2433-4672-4d64-a885-ac67352d1a16 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:25.054322 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-648a2433-4672-4d64-a885-ac67352d1a16 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:25.055017 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-648a2433-4672-4d64-a885-ac67352d1a16 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:25.055462 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-648a2433-4672-4d64-a885-ac67352d1a16 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:25.055879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-648a2433-4672-4d64-a885-ac67352d1a16 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:25.193631 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-648a2433-4672-4d64-a885-ac67352d1a16 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:25.201600 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-648a2433-4672-4d64-a885-ac67352d1a16 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.158536 Oct 20 13:38:25.202171 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 203/387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:25 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:25.565157 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c4c44b14-f0f0-408a-8de8-e2a0a021aed4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:25.565811 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-c4c44b14-f0f0-408a-8de8-e2a0a021aed4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:25.573713 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c4c44b14-f0f0-408a-8de8-e2a0a021aed4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:25.574379 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c4c44b14-f0f0-408a-8de8-e2a0a021aed4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:25.574889 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c4c44b14-f0f0-408a-8de8-e2a0a021aed4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:25.575807 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c4c44b14-f0f0-408a-8de8-e2a0a021aed4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:25.576335 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c4c44b14-f0f0-408a-8de8-e2a0a021aed4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:25.576939 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c4c44b14-f0f0-408a-8de8-e2a0a021aed4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:25.716156 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c4c44b14-f0f0-408a-8de8-e2a0a021aed4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:25.724835 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-c4c44b14-f0f0-408a-8de8-e2a0a021aed4 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.163582 Oct 20 13:38:25.725749 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 204/388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:25 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:25.750130 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:25.750994 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:25.757398 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:25.757880 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:25.758469 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:25.759188 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:25.759643 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:25.760068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:25.764826 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=100 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:25.906944 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:25.917411 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:25.918861 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:25.920044 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-4d3bf5ec-0222-42be-b6a7-193eae990777 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.174188 Oct 20 13:38:25.920595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 205/389] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:25 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:26.225179 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b29dfbda-541a-4b31-a437-462b74bb739c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:26.225826 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b29dfbda-541a-4b31-a437-462b74bb739c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:26.232215 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29dfbda-541a-4b31-a437-462b74bb739c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:26.232728 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29dfbda-541a-4b31-a437-462b74bb739c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:26.233216 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29dfbda-541a-4b31-a437-462b74bb739c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:26.233874 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29dfbda-541a-4b31-a437-462b74bb739c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:26.234314 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29dfbda-541a-4b31-a437-462b74bb739c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:26.234733 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29dfbda-541a-4b31-a437-462b74bb739c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:26.369954 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b29dfbda-541a-4b31-a437-462b74bb739c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:26.377876 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b29dfbda-541a-4b31-a437-462b74bb739c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.157600 Oct 20 13:38:26.378439 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 206/390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:26 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:26.748387 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-88f4a699-1e2f-4ed9-a5c5-f5f88006a029 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:26.749290 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-88f4a699-1e2f-4ed9-a5c5-f5f88006a029 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:26.756495 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-88f4a699-1e2f-4ed9-a5c5-f5f88006a029 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:26.756927 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-88f4a699-1e2f-4ed9-a5c5-f5f88006a029 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:26.757380 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-88f4a699-1e2f-4ed9-a5c5-f5f88006a029 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:26.758082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-88f4a699-1e2f-4ed9-a5c5-f5f88006a029 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:26.758538 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-88f4a699-1e2f-4ed9-a5c5-f5f88006a029 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:26.758967 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-88f4a699-1e2f-4ed9-a5c5-f5f88006a029 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:26.905310 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-88f4a699-1e2f-4ed9-a5c5-f5f88006a029 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:26.912885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-88f4a699-1e2f-4ed9-a5c5-f5f88006a029 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.168344 Oct 20 13:38:26.913448 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 207/391] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:26 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:26.947843 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:26.948457 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:26.956436 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:26.956927 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:26.957387 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:26.958085 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:26.958531 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:26.958946 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:27.096192 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:27.105680 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:27.107142 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:27.108298 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5397d578-1148-4794-8295-6a8a0e983e95 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.165663 Oct 20 13:38:27.108854 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 208/392] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:26 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:27.404422 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-275d5fed-2699-4a7b-b099-c73afc0f0d38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:27.405233 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-275d5fed-2699-4a7b-b099-c73afc0f0d38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:27.412799 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-275d5fed-2699-4a7b-b099-c73afc0f0d38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:27.413326 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-275d5fed-2699-4a7b-b099-c73afc0f0d38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:27.413758 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-275d5fed-2699-4a7b-b099-c73afc0f0d38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:27.414486 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-275d5fed-2699-4a7b-b099-c73afc0f0d38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:27.414935 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-275d5fed-2699-4a7b-b099-c73afc0f0d38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:27.415353 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-275d5fed-2699-4a7b-b099-c73afc0f0d38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:27.557330 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-275d5fed-2699-4a7b-b099-c73afc0f0d38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:27.565295 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-275d5fed-2699-4a7b-b099-c73afc0f0d38 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.165681 Oct 20 13:38:27.565801 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 209/393] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:27 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:27.937977 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-37bbc577-77a0-49af-91c8-5b8a1196fa01 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:27.938588 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-37bbc577-77a0-49af-91c8-5b8a1196fa01 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:27.945758 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-37bbc577-77a0-49af-91c8-5b8a1196fa01 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:27.946236 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-37bbc577-77a0-49af-91c8-5b8a1196fa01 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:27.946660 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-37bbc577-77a0-49af-91c8-5b8a1196fa01 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:27.947348 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-37bbc577-77a0-49af-91c8-5b8a1196fa01 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:27.947793 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-37bbc577-77a0-49af-91c8-5b8a1196fa01 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:27.948208 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-37bbc577-77a0-49af-91c8-5b8a1196fa01 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:28.087254 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-37bbc577-77a0-49af-91c8-5b8a1196fa01 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:28.094994 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-37bbc577-77a0-49af-91c8-5b8a1196fa01 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.161500 Oct 20 13:38:28.095555 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 210/394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:27 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:28.133804 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:28.134406 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:28.140241 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:28.140725 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:28.141258 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:28.141945 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:28.142396 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:28.142815 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:28.271750 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:28.280440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:28.281950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:28.283095 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-039da6af-796b-42f5-906c-500cce7d3526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.152878 Oct 20 13:38:28.283647 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 211/395] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:28 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:28.588935 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-adc340b6-baf0-4ea3-9c33-0d5e64f3542b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:28.589540 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-adc340b6-baf0-4ea3-9c33-0d5e64f3542b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:28.595372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adc340b6-baf0-4ea3-9c33-0d5e64f3542b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:28.595905 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adc340b6-baf0-4ea3-9c33-0d5e64f3542b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:28.596308 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adc340b6-baf0-4ea3-9c33-0d5e64f3542b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:28.597019 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adc340b6-baf0-4ea3-9c33-0d5e64f3542b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:28.597466 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adc340b6-baf0-4ea3-9c33-0d5e64f3542b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:28.597984 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-adc340b6-baf0-4ea3-9c33-0d5e64f3542b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:28.748662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-adc340b6-baf0-4ea3-9c33-0d5e64f3542b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:28.758034 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-adc340b6-baf0-4ea3-9c33-0d5e64f3542b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.172393 Oct 20 13:38:28.758718 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 212/396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:28 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:28.962683 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:28.982172 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4b2503c6-cc8c-4ae2-b18d-45ee672cec5a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "POST /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.656981 Oct 20 13:38:28.982827 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 185/397] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:38:24 2022] POST /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e/os-volume_attachments => generated 194 bytes in 4658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:38:29.118793 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d8ab699f-3187-428d-8575-b5bacac34a4c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:29.119408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d8ab699f-3187-428d-8575-b5bacac34a4c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:29.126092 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8ab699f-3187-428d-8575-b5bacac34a4c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:29.126576 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8ab699f-3187-428d-8575-b5bacac34a4c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:29.127014 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8ab699f-3187-428d-8575-b5bacac34a4c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:29.127703 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8ab699f-3187-428d-8575-b5bacac34a4c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:29.128158 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8ab699f-3187-428d-8575-b5bacac34a4c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:29.128578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d8ab699f-3187-428d-8575-b5bacac34a4c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:29.258831 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d8ab699f-3187-428d-8575-b5bacac34a4c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:29.266357 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d8ab699f-3187-428d-8575-b5bacac34a4c tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.151360 Oct 20 13:38:29.266918 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 213/398] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:29 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:29.310701 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:29.310853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:29.316903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:29.317371 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:29.317794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:29.318471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:29.318912 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:29.319323 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:29.446695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:29.456343 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:29.458286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:29.459491 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ed6db7f1-424f-4d69-8c31-8f8dcdbb11b6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.153940 Oct 20 13:38:29.460038 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 186/399] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:29 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:29.781925 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-66d03b05-b2b5-4d2b-9326-92aac49de0cb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:29.782570 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-66d03b05-b2b5-4d2b-9326-92aac49de0cb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:29.789070 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66d03b05-b2b5-4d2b-9326-92aac49de0cb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:29.789555 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66d03b05-b2b5-4d2b-9326-92aac49de0cb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:29.789988 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66d03b05-b2b5-4d2b-9326-92aac49de0cb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:29.790678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66d03b05-b2b5-4d2b-9326-92aac49de0cb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:29.791132 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66d03b05-b2b5-4d2b-9326-92aac49de0cb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:29.791556 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66d03b05-b2b5-4d2b-9326-92aac49de0cb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:29.920420 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-66d03b05-b2b5-4d2b-9326-92aac49de0cb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:29.928622 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-66d03b05-b2b5-4d2b-9326-92aac49de0cb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.150575 Oct 20 13:38:29.929221 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 214/400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:29 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:30.290087 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7085990d-3269-4c64-9960-61e36a059b8e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:30.290715 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7085990d-3269-4c64-9960-61e36a059b8e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:30.297287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7085990d-3269-4c64-9960-61e36a059b8e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:30.297769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7085990d-3269-4c64-9960-61e36a059b8e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:30.298196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7085990d-3269-4c64-9960-61e36a059b8e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:30.298878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7085990d-3269-4c64-9960-61e36a059b8e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:30.299320 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7085990d-3269-4c64-9960-61e36a059b8e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:30.299738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7085990d-3269-4c64-9960-61e36a059b8e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:30.432365 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7085990d-3269-4c64-9960-61e36a059b8e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:30.439906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7085990d-3269-4c64-9960-61e36a059b8e tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.153657 Oct 20 13:38:30.440461 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 187/401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:30 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:30.485769 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:30.486368 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:30.493661 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:30.494147 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:30.494587 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:30.495287 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:30.495747 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:30.496172 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:30.626711 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:30.635434 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:30.636802 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:30.638048 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-820f1dbc-8111-4bf5-89a4-d2e5340bb5e9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.156186 Oct 20 13:38:30.638605 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 215/402] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:30 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:30.951548 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6eb490cd-e132-47cc-8f8a-b9ec998fe64b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:30.952101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6eb490cd-e132-47cc-8f8a-b9ec998fe64b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:30.959346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6eb490cd-e132-47cc-8f8a-b9ec998fe64b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:30.959817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6eb490cd-e132-47cc-8f8a-b9ec998fe64b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:30.960241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6eb490cd-e132-47cc-8f8a-b9ec998fe64b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:30.960938 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6eb490cd-e132-47cc-8f8a-b9ec998fe64b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:30.961386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6eb490cd-e132-47cc-8f8a-b9ec998fe64b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:30.961799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6eb490cd-e132-47cc-8f8a-b9ec998fe64b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:31.088323 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6eb490cd-e132-47cc-8f8a-b9ec998fe64b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:31.095953 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-6eb490cd-e132-47cc-8f8a-b9ec998fe64b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.148272 Oct 20 13:38:31.096519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 188/403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:30 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:31.462435 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-85c2c434-49a3-4852-9fda-c855e5e84a93 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:31.463049 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-85c2c434-49a3-4852-9fda-c855e5e84a93 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:31.469035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-85c2c434-49a3-4852-9fda-c855e5e84a93 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:31.469522 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-85c2c434-49a3-4852-9fda-c855e5e84a93 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:31.469956 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-85c2c434-49a3-4852-9fda-c855e5e84a93 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:31.470640 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-85c2c434-49a3-4852-9fda-c855e5e84a93 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:31.471090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-85c2c434-49a3-4852-9fda-c855e5e84a93 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:31.471519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-85c2c434-49a3-4852-9fda-c855e5e84a93 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:31.600833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-85c2c434-49a3-4852-9fda-c855e5e84a93 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:31.608497 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-85c2c434-49a3-4852-9fda-c855e5e84a93 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1267 microversion: 2.1 time: 0.149946 Oct 20 13:38:31.609083 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 216/404] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:31 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:31.664103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:31.664709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:31.670564 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:31.671046 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:31.671479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:31.672163 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:31.672611 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:31.673069 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:31.799842 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:31.809489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:31.810995 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:31.812133 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-36261037-884d-4a86-99df-016c26c20926 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.152374 Oct 20 13:38:31.812693 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 189/405] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:31 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:32.117979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3ed2e64b-cfa1-427d-8cae-ce30e7d121a2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:32.118594 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3ed2e64b-cfa1-427d-8cae-ce30e7d121a2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:32.124465 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3ed2e64b-cfa1-427d-8cae-ce30e7d121a2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:32.124971 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3ed2e64b-cfa1-427d-8cae-ce30e7d121a2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:32.125653 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3ed2e64b-cfa1-427d-8cae-ce30e7d121a2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:32.126331 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3ed2e64b-cfa1-427d-8cae-ce30e7d121a2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:32.126778 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3ed2e64b-cfa1-427d-8cae-ce30e7d121a2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:32.127197 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3ed2e64b-cfa1-427d-8cae-ce30e7d121a2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:32.258971 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3ed2e64b-cfa1-427d-8cae-ce30e7d121a2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:32.266635 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3ed2e64b-cfa1-427d-8cae-ce30e7d121a2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.152505 Oct 20 13:38:32.267193 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 217/406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:32 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:32.632343 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a1dff4bc-c29f-4195-a4e9-d0df9952bc79 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:32.632988 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a1dff4bc-c29f-4195-a4e9-d0df9952bc79 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:32.639832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1dff4bc-c29f-4195-a4e9-d0df9952bc79 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:32.640319 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1dff4bc-c29f-4195-a4e9-d0df9952bc79 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:32.640750 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1dff4bc-c29f-4195-a4e9-d0df9952bc79 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:32.641459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1dff4bc-c29f-4195-a4e9-d0df9952bc79 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:32.641935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1dff4bc-c29f-4195-a4e9-d0df9952bc79 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:32.642412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1dff4bc-c29f-4195-a4e9-d0df9952bc79 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:32.781167 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a1dff4bc-c29f-4195-a4e9-d0df9952bc79 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:32.788796 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a1dff4bc-c29f-4195-a4e9-d0df9952bc79 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1454 microversion: 2.1 time: 0.160881 Oct 20 13:38:32.789424 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 190/407] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:32 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:32.811665 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b3efa00b-68d9-4522-846e-81147fbdf606 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:32.812410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b3efa00b-68d9-4522-846e-81147fbdf606 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:32.819553 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b3efa00b-68d9-4522-846e-81147fbdf606 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:32.820036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b3efa00b-68d9-4522-846e-81147fbdf606 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:32.820471 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b3efa00b-68d9-4522-846e-81147fbdf606 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:32.821188 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b3efa00b-68d9-4522-846e-81147fbdf606 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:32.821640 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b3efa00b-68d9-4522-846e-81147fbdf606 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:32.822062 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b3efa00b-68d9-4522-846e-81147fbdf606 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:32.838201 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:32.838921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:32.844748 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:32.845322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:32.845813 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:32.846492 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:32.846930 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:32.847854 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:32.953234 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b3efa00b-68d9-4522-846e-81147fbdf606 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:32.961637 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b3efa00b-68d9-4522-846e-81147fbdf606 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1454 microversion: 2.1 time: 0.153740 Oct 20 13:38:32.962203 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 218/408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:32 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:32.979462 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:32.988218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:32.989845 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:32.990988 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-927c6f23-a3f9-4c70-8728-593505b6738c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.156869 Oct 20 13:38:32.991540 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 191/409] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:32 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:33.291959 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-12ac31fd-be19-431c-83ec-e0d89cf7ecdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:33.292577 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-12ac31fd-be19-431c-83ec-e0d89cf7ecdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:33.300363 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-12ac31fd-be19-431c-83ec-e0d89cf7ecdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:33.301589 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-12ac31fd-be19-431c-83ec-e0d89cf7ecdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:33.302092 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-12ac31fd-be19-431c-83ec-e0d89cf7ecdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:33.303035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-12ac31fd-be19-431c-83ec-e0d89cf7ecdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:33.303495 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-12ac31fd-be19-431c-83ec-e0d89cf7ecdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:33.304484 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-12ac31fd-be19-431c-83ec-e0d89cf7ecdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:33.437919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-12ac31fd-be19-431c-83ec-e0d89cf7ecdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:33.446148 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-12ac31fd-be19-431c-83ec-e0d89cf7ecdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1502 microversion: 2.1 time: 0.159188 Oct 20 13:38:33.446916 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 219/410] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:33 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:33.468894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e457a69-e94c-4e02-ae48-fb6be312c7cc"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:33.471270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:33.478184 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:33.478662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:33.479121 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:33.480020 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:33.480513 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:33.480952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:33.505273 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] HTTP exception thrown: Cannot 'attach_volume' instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a while it is in vm_state rescued Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Request method failure captured: Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: POST /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a/os-volume_attachments HTTP/1.1 Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 74 Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU8EDd2vvUkyylhpotEJuKhlQDubD9a2W47vQITa7_dG2nMwmvFN7_QN2e2GI7GmwXpvLgSDZL0hzO6FAo5Na9GQVkD2x8Dg10Cs_2xd4l6hUlYtTtVpt4tIrTj8WeaKunzXxZGIY1rQk91fRfU3fGLHySl-I-o-9dOdjyRaOjT2KAc Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: f36e9fb394944eb0a0c2c0075dbc937c Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:38:33.507197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: f36e9fb394944eb0a0c2c0075dbc937c Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-ServerRescueNegativeTestJSON-1341728080-project Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 2dd45d3b097c46c28eb94c5e0bd2a7a6 Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1341728080-project Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {"volumeAttachment": {"volumeId": "4e457a69-e94c-4e02-ae48-fb6be312c7cc"}} Oct 20 13:38:33.508697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Cannot 'attach_volume' instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a while it is in vm_state rescued Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'server_id': '81af22d4-c2fa-4c17-9ab2-8cd63758321a', 'body': {'volumeAttachment': {'volumeId': '4e457a69-e94c-4e02-ae48-fb6be312c7cc'}}} Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:38:33.509565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a while it is in vm_state rescued Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:38:33.510844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:38:33.512085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:38:33.512085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:38:33.512085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a while it is in vm_state rescued Oct 20 13:38:33.512085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:38:33.513078 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Returning 409 to user: Cannot 'attach_volume' instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a while it is in vm_state rescued {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:38:33.514272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-6515dcd0-db46-4b33-b151-41b61ea3e8c2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049066 Oct 20 13:38:33.514487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 192/411] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:38:33 2022] POST /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 20 13:38:33.522662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9ee06c30-85ae-421e-afc1-80edcb861868 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:33.523194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9ee06c30-85ae-421e-afc1-80edcb861868 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:33.529051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9ee06c30-85ae-421e-afc1-80edcb861868 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:33.529518 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9ee06c30-85ae-421e-afc1-80edcb861868 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:33.529949 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9ee06c30-85ae-421e-afc1-80edcb861868 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:33.530662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9ee06c30-85ae-421e-afc1-80edcb861868 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:33.531110 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9ee06c30-85ae-421e-afc1-80edcb861868 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:33.531527 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9ee06c30-85ae-421e-afc1-80edcb861868 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:33.589867 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:33.600339 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9ee06c30-85ae-421e-afc1-80edcb861868 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a/action" status: 202 len: 0 microversion: 2.1 time: 0.080762 Oct 20 13:38:33.603669 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 220/412] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:38:33 2022] POST /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:38:33.608625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a1aa87f7-6a95-4854-a204-b25065cbff8e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:33.609247 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a1aa87f7-6a95-4854-a204-b25065cbff8e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:33.616627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1aa87f7-6a95-4854-a204-b25065cbff8e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:33.617135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1aa87f7-6a95-4854-a204-b25065cbff8e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:33.617564 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1aa87f7-6a95-4854-a204-b25065cbff8e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:33.618245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1aa87f7-6a95-4854-a204-b25065cbff8e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:33.618688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1aa87f7-6a95-4854-a204-b25065cbff8e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:33.619103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a1aa87f7-6a95-4854-a204-b25065cbff8e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:33.850347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a1aa87f7-6a95-4854-a204-b25065cbff8e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:33.857963 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a1aa87f7-6a95-4854-a204-b25065cbff8e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1510 microversion: 2.1 time: 0.253088 Oct 20 13:38:33.858527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 193/413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:33 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:34.016737 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:34.017475 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:34.024631 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:34.025141 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:34.025575 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:34.026277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:34.026732 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:34.027158 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:34.163415 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:34.172379 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:34.174028 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:34.175330 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-64a6e08a-e4f0-4fd3-a1ea-21819ce6deeb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.163355 Oct 20 13:38:34.175992 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 221/414] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:34 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:34.869471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-4e554ed9-2cbb-4ea5-9cce-d7007adf0ee8 req-7aa876c1-2385-473a-a913-caa0347a6f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a95c3c3-dcce-457b-98df-7b6ff3df8680", "tag": "819ed6f1-641c-46ab-baf3-306b4b54da88"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:34.882083 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-ab6285ee-ef0e-4d37-a365-96081e996bad tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:34.882692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-ab6285ee-ef0e-4d37-a365-96081e996bad tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:34.888728 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ab6285ee-ef0e-4d37-a365-96081e996bad tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:34.889269 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ab6285ee-ef0e-4d37-a365-96081e996bad tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:34.889707 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ab6285ee-ef0e-4d37-a365-96081e996bad tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:34.890401 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ab6285ee-ef0e-4d37-a365-96081e996bad tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:34.890852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ab6285ee-ef0e-4d37-a365-96081e996bad tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:34.891273 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ab6285ee-ef0e-4d37-a365-96081e996bad tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:34.899662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-4e554ed9-2cbb-4ea5-9cce-d7007adf0ee8 req-7aa876c1-2385-473a-a913-caa0347a6f9e service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:34.900144 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-4e554ed9-2cbb-4ea5-9cce-d7007adf0ee8 req-7aa876c1-2385-473a-a913-caa0347a6f9e service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:34.900563 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-4e554ed9-2cbb-4ea5-9cce-d7007adf0ee8 req-7aa876c1-2385-473a-a913-caa0347a6f9e service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:34.912533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-4e554ed9-2cbb-4ea5-9cce-d7007adf0ee8 req-7aa876c1-2385-473a-a913-caa0347a6f9e service nova] Creating event network-changed:819ed6f1-641c-46ab-baf3-306b4b54da88 for instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 on hv-cinder-86213 Oct 20 13:38:34.917577 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-4e554ed9-2cbb-4ea5-9cce-d7007adf0ee8 req-7aa876c1-2385-473a-a913-caa0347a6f9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051898 Oct 20 13:38:34.918176 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 194/415] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:38:35.021648 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-ab6285ee-ef0e-4d37-a365-96081e996bad tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:35.029420 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-ab6285ee-ef0e-4d37-a365-96081e996bad tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1510 microversion: 2.1 time: 0.151959 Oct 20 13:38:35.029983 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 222/416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:34 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:35.201778 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:35.202470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:35.209209 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:35.209695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:35.210128 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:35.210871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:35.211327 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:35.211754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:35.343782 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:35.352935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:35.354399 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:35.355575 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-38170494-1045-43d8-9b39-87cbf6673c73 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.158065 Oct 20 13:38:35.356167 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 195/417] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:35 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:36.053838 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-cbe7ad2a-0d63-4742-84aa-048fcc43bf01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:36.054455 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-cbe7ad2a-0d63-4742-84aa-048fcc43bf01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:36.060798 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad2a-0d63-4742-84aa-048fcc43bf01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:36.061327 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad2a-0d63-4742-84aa-048fcc43bf01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:36.061759 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad2a-0d63-4742-84aa-048fcc43bf01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:36.062442 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad2a-0d63-4742-84aa-048fcc43bf01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:36.062892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad2a-0d63-4742-84aa-048fcc43bf01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:36.063308 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad2a-0d63-4742-84aa-048fcc43bf01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:36.211469 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-cbe7ad2a-0d63-4742-84aa-048fcc43bf01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:36.221142 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-cbe7ad2a-0d63-4742-84aa-048fcc43bf01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1510 microversion: 2.1 time: 0.171062 Oct 20 13:38:36.221868 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 223/418] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:36 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:36.381550 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:36.382159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:36.388635 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:36.389152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:36.389789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:36.390487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:36.390942 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:36.391364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:36.875812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:36.885127 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:36.886584 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:36.887772 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0c1b7e8d-ade7-481d-b400-0699ee509875 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.510792 Oct 20 13:38:36.888920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 196/419] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:36 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:37.244696 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-2205cabe-6d8f-4882-9100-93c56664e89b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:37.245269 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-2205cabe-6d8f-4882-9100-93c56664e89b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:37.251846 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2205cabe-6d8f-4882-9100-93c56664e89b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:37.252325 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2205cabe-6d8f-4882-9100-93c56664e89b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:37.252758 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2205cabe-6d8f-4882-9100-93c56664e89b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:37.253966 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2205cabe-6d8f-4882-9100-93c56664e89b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:37.254410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2205cabe-6d8f-4882-9100-93c56664e89b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:37.254828 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2205cabe-6d8f-4882-9100-93c56664e89b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:37.383170 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-2205cabe-6d8f-4882-9100-93c56664e89b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:37.390909 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-2205cabe-6d8f-4882-9100-93c56664e89b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1510 microversion: 2.1 time: 0.150148 Oct 20 13:38:37.391477 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 224/420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:37 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:37.914424 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:37.915047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:37.921396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:37.921872 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:37.922296 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:37.922967 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:37.923411 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:37.923824 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:38.048969 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:38.057417 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:38.058856 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:38.059981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-87e94a12-a319-4c7c-a19a-b78559967813 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.149471 Oct 20 13:38:38.060534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 197/421] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:37 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:38.414208 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-77ec17d7-1c0f-4501-abb0-af34acbf1018 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:38.414822 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-77ec17d7-1c0f-4501-abb0-af34acbf1018 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:38.421291 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-77ec17d7-1c0f-4501-abb0-af34acbf1018 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:38.421776 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-77ec17d7-1c0f-4501-abb0-af34acbf1018 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:38.422206 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-77ec17d7-1c0f-4501-abb0-af34acbf1018 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:38.422887 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-77ec17d7-1c0f-4501-abb0-af34acbf1018 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:38.423339 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-77ec17d7-1c0f-4501-abb0-af34acbf1018 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:38.423761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-77ec17d7-1c0f-4501-abb0-af34acbf1018 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:38.566434 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-77ec17d7-1c0f-4501-abb0-af34acbf1018 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:38.575205 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-77ec17d7-1c0f-4501-abb0-af34acbf1018 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1510 microversion: 2.1 time: 0.165362 Oct 20 13:38:38.575775 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 225/422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:38 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:39.086407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:39.087543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:39.093347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:39.093820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:39.094243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:39.094917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:39.095358 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:39.095771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:39.223861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:39.232255 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:39.233705 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:39.234875 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-08685684-5758-479e-ae63-42427885b0d1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.153184 Oct 20 13:38:39.235446 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 198/423] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:39 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:39.599817 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5a4a1256-1af2-40d1-adfe-17a59ffb3b26 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:39.600371 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5a4a1256-1af2-40d1-adfe-17a59ffb3b26 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:39.606863 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a4a1256-1af2-40d1-adfe-17a59ffb3b26 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:39.607346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a4a1256-1af2-40d1-adfe-17a59ffb3b26 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:39.607780 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a4a1256-1af2-40d1-adfe-17a59ffb3b26 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:39.608467 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a4a1256-1af2-40d1-adfe-17a59ffb3b26 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:39.608946 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a4a1256-1af2-40d1-adfe-17a59ffb3b26 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:39.609370 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5a4a1256-1af2-40d1-adfe-17a59ffb3b26 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:39.736418 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5a4a1256-1af2-40d1-adfe-17a59ffb3b26 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:39.744575 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5a4a1256-1af2-40d1-adfe-17a59ffb3b26 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1510 microversion: 2.1 time: 0.149097 Oct 20 13:38:39.745168 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 226/424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:39 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:40.260727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:40.261483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:40.263928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:40.269435 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:40.270123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:40.270556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:40.271285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:40.271745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:40.272173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:40.399651 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:40.408226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:40.410450 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:40.411601 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f51abcc4-791e-4064-a617-46785b26fed7 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.154880 Oct 20 13:38:40.412163 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 199/425] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:40 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:40.769774 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-aca9b054-9071-49ba-a550-f4f2d3133715 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:40.770308 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-aca9b054-9071-49ba-a550-f4f2d3133715 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:40.776255 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aca9b054-9071-49ba-a550-f4f2d3133715 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:40.776729 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aca9b054-9071-49ba-a550-f4f2d3133715 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:40.777197 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aca9b054-9071-49ba-a550-f4f2d3133715 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:40.777873 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aca9b054-9071-49ba-a550-f4f2d3133715 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:40.778319 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aca9b054-9071-49ba-a550-f4f2d3133715 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:40.778738 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aca9b054-9071-49ba-a550-f4f2d3133715 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:40.907046 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-aca9b054-9071-49ba-a550-f4f2d3133715 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:40.915837 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-aca9b054-9071-49ba-a550-f4f2d3133715 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1510 microversion: 2.1 time: 0.150212 Oct 20 13:38:40.916403 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 227/426] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:40 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:41.437758 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:41.438359 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:41.442464 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-1530ffaa-b8ce-4847-9c3e-55fb663fa849 req-4be704c5-115b-435a-8d23-3881b2b17996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b9ae5b-1e55-409f-9a61-b1e2a47d1b58", "name": "network-vif-plugged", "status": "completed", "tag": "c4329cd6-ac99-4465-b271-c87f6eb593c4"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:41.445298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:41.445778 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:41.446203 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:41.446880 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:41.447589 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:41.448036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:41.452641 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-1530ffaa-b8ce-4847-9c3e-55fb663fa849 req-4be704c5-115b-435a-8d23-3881b2b17996 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:41.453175 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-1530ffaa-b8ce-4847-9c3e-55fb663fa849 req-4be704c5-115b-435a-8d23-3881b2b17996 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:41.453661 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-1530ffaa-b8ce-4847-9c3e-55fb663fa849 req-4be704c5-115b-435a-8d23-3881b2b17996 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:41.465991 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-1530ffaa-b8ce-4847-9c3e-55fb663fa849 req-4be704c5-115b-435a-8d23-3881b2b17996 service nova] Creating event network-vif-plugged:c4329cd6-ac99-4465-b271-c87f6eb593c4 for instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 on hv-cinder-86213 Oct 20 13:38:41.471116 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-1530ffaa-b8ce-4847-9c3e-55fb663fa849 req-4be704c5-115b-435a-8d23-3881b2b17996 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033131 Oct 20 13:38:41.472459 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 228/427] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:38:41.583519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:41.591990 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:41.593469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:41.594634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f66fde33-68d1-4f6e-b8d3-a28a8d4ede68 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.161264 Oct 20 13:38:41.595183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 200/428] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:41 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:41.940457 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-658e481d-ac84-404e-99a9-b1484d3e8f2d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:41.941208 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-658e481d-ac84-404e-99a9-b1484d3e8f2d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:41.947839 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-658e481d-ac84-404e-99a9-b1484d3e8f2d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:41.948318 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-658e481d-ac84-404e-99a9-b1484d3e8f2d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:41.948745 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-658e481d-ac84-404e-99a9-b1484d3e8f2d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:41.949451 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-658e481d-ac84-404e-99a9-b1484d3e8f2d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:41.949905 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-658e481d-ac84-404e-99a9-b1484d3e8f2d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:41.950323 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-658e481d-ac84-404e-99a9-b1484d3e8f2d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:42.084826 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-658e481d-ac84-404e-99a9-b1484d3e8f2d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:42.092436 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-658e481d-ac84-404e-99a9-b1484d3e8f2d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1510 microversion: 2.1 time: 0.156548 Oct 20 13:38:42.093028 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 229/429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:41 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:42.621083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:42.621741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:42.629097 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:42.629636 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:42.630069 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:42.630751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:42.631200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:42.631621 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:42.757151 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:42.765954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:42.767313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:42.768437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-373480f0-2f0d-4f98-9055-470869761197 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.151360 Oct 20 13:38:42.769079 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 201/430] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:42 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:43.116104 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-120623a0-beba-4ddb-9faf-3885f3f01e5d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:43.116804 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-120623a0-beba-4ddb-9faf-3885f3f01e5d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:43.123326 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-120623a0-beba-4ddb-9faf-3885f3f01e5d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:43.123801 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-120623a0-beba-4ddb-9faf-3885f3f01e5d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:43.124226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-120623a0-beba-4ddb-9faf-3885f3f01e5d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:43.125191 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-120623a0-beba-4ddb-9faf-3885f3f01e5d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:43.125636 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-120623a0-beba-4ddb-9faf-3885f3f01e5d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:43.126052 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-120623a0-beba-4ddb-9faf-3885f3f01e5d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:43.253973 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-120623a0-beba-4ddb-9faf-3885f3f01e5d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:43.261540 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-120623a0-beba-4ddb-9faf-3885f3f01e5d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1510 microversion: 2.1 time: 0.149958 Oct 20 13:38:43.262097 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 230/431] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:43 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:43.793863 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:43.794387 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:43.801538 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:43.802015 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:43.802446 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:43.803127 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:43.803576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:43.803993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:43.928819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:43.932240 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:43.938029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:43.939513 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:43.940795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ce771f0b-80c5-45b6-b593-8c6f3f6fced0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.150784 Oct 20 13:38:43.941395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 202/432] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:43 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:44.283843 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-99217472-7c8f-4cc7-a45a-ceaf806a019d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:44.284502 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-99217472-7c8f-4cc7-a45a-ceaf806a019d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:44.290839 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-99217472-7c8f-4cc7-a45a-ceaf806a019d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:44.291320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-99217472-7c8f-4cc7-a45a-ceaf806a019d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:44.291748 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-99217472-7c8f-4cc7-a45a-ceaf806a019d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:44.292422 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-99217472-7c8f-4cc7-a45a-ceaf806a019d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:44.292883 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-99217472-7c8f-4cc7-a45a-ceaf806a019d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:44.293305 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-99217472-7c8f-4cc7-a45a-ceaf806a019d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:44.423007 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-99217472-7c8f-4cc7-a45a-ceaf806a019d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:44.431101 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-99217472-7c8f-4cc7-a45a-ceaf806a019d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1510 microversion: 2.1 time: 0.151123 Oct 20 13:38:44.431667 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 231/433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:44 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:44.966166 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:44.966762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:44.974469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:44.974941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:44.975371 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:44.976053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:44.976495 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:44.976952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:45.108972 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:45.119235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:45.122319 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:45.124954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b57fb836-7f3f-4146-aeaf-0feeb5b60e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.161922 Oct 20 13:38:45.126294 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 203/434] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:44 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:45.454422 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-fa3cea18-d74e-471b-b133-5325c5d0e2a6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:45.455051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-fa3cea18-d74e-471b-b133-5325c5d0e2a6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:45.461398 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fa3cea18-d74e-471b-b133-5325c5d0e2a6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:45.461870 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fa3cea18-d74e-471b-b133-5325c5d0e2a6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:45.462299 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fa3cea18-d74e-471b-b133-5325c5d0e2a6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:45.462970 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fa3cea18-d74e-471b-b133-5325c5d0e2a6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:45.463414 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fa3cea18-d74e-471b-b133-5325c5d0e2a6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:45.463830 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-fa3cea18-d74e-471b-b133-5325c5d0e2a6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:45.593865 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-fa3cea18-d74e-471b-b133-5325c5d0e2a6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:45.602171 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-fa3cea18-d74e-471b-b133-5325c5d0e2a6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1516 microversion: 2.1 time: 0.151655 Oct 20 13:38:45.602739 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 232/435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:45 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:46.150796 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:46.151427 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:46.157819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:46.158296 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:46.158720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:46.160073 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:46.160520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:46.160969 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:46.291574 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:46.300600 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:46.302075 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:46.303201 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-32daadaa-d6d1-417e-8a7c-2fb07ba1f76b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.156267 Oct 20 13:38:46.303746 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 204/436] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:46 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:47.328095 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:47.328708 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:47.335533 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:47.336016 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:47.336451 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:47.337170 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:47.337626 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:47.338047 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:47.464133 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:47.473620 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:47.475073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:47.476273 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-720174be-9904-455b-9942-bffd21f5bdc0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.152122 Oct 20 13:38:47.476857 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 233/437] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:47 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:48.503223 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:48.503977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:48.516509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:48.517454 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:48.518163 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:48.520492 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:48.521003 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:48.521617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:48.635221 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-982ef648-a1b5-4450-9ea9-c6f69c5ec240 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:48.635747 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-982ef648-a1b5-4450-9ea9-c6f69c5ec240 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:48.642195 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-982ef648-a1b5-4450-9ea9-c6f69c5ec240 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:48.642685 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-982ef648-a1b5-4450-9ea9-c6f69c5ec240 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:48.643117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-982ef648-a1b5-4450-9ea9-c6f69c5ec240 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:48.643833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-982ef648-a1b5-4450-9ea9-c6f69c5ec240 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:48.644364 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-982ef648-a1b5-4450-9ea9-c6f69c5ec240 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:48.644785 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-982ef648-a1b5-4450-9ea9-c6f69c5ec240 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:48.774389 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.objects.instance [None req-982ef648-a1b5-4450-9ea9-c6f69c5ec240 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'services' on Instance uuid 19146772-f7e2-43d8-b7b3-3c365f024e54 {{(pid=125447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:38:48.848159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:48.856757 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:48.858212 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:48.859354 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-587a40eb-3481-4791-bb71-c7a250e6b850 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.361691 Oct 20 13:38:48.859916 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 205/438] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:48 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:38:48.898014 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-982ef648-a1b5-4450-9ea9-c6f69c5ec240 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/os-volume_attachments/17329b13-e30e-4e90-b3d0-63b143df9262" status: 202 len: 0 microversion: 2.1 time: 0.266614 Oct 20 13:38:48.898522 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 234/439] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:38:48 2022] DELETE /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/os-volume_attachments/17329b13-e30e-4e90-b3d0-63b143df9262 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:38:49.058140 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3bcd0749-5bcb-4816-a2b0-3e646c5a1645 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'create', calling method: .version_select at 0x7ffa12e8b8b0>, body: {"keypair": {"name": "tempest-keypair-1893496124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFMKJr//pSidGJzhIY9+eyGN1EbNwxH/7GkFb3vJhs+5c9EPnu7pHuLYoODM76Y6MURa2/YxIY1MENhs6abrQ4uNBmuzqDzuxFdjMzmr6Bj26wHyg90BMkOXhFrFHfIAg=="}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:49.073601 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-3bcd0749-5bcb-4816-a2b0-3e646c5a1645 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Getting quotas for project f36e9fb394944eb0a0c2c0075dbc937c. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:38:49.077361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-3bcd0749-5bcb-4816-a2b0-3e646c5a1645 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Getting quotas for user 2dd45d3b097c46c28eb94c5e0bd2a7a6 and project f36e9fb394944eb0a0c2c0075dbc937c. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:38:49.089328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3bcd0749-5bcb-4816-a2b0-3e646c5a1645 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [9ee24583-f273-43f9-b38c-d4d994bd4737] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 20 13:38:49.886265 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:49.887001 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:49.893892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:49.894385 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:49.894820 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:49.895509 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:49.895964 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:49.896398 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:50.027944 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:50.036805 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:50.038277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:50.039412 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-00b06bd1-8590-4079-900b-250c05089ca2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.157974 Oct 20 13:38:50.039960 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 235/440] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:49 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:50.096383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO oslo.messaging._drivers.impl_rabbit [None req-3bcd0749-5bcb-4816-a2b0-3e646c5a1645 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [9ee24583-f273-43f9-b38c-d4d994bd4737] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37060. Oct 20 13:38:50.109975 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3bcd0749-5bcb-4816-a2b0-3e646c5a1645 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.055623 Oct 20 13:38:50.110737 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 206/441] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 20 13:38:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:38:51.067502 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:51.068974 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:51.075518 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:51.075966 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:51.077166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:51.077166 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:51.077591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:51.078042 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:51.092734 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-bfa310f6-7d23-4e7a-b247-a00886fa933b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:51.116223 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bfa310f6-7d23-4e7a-b247-a00886fa933b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:51.117782 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bfa310f6-7d23-4e7a-b247-a00886fa933b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:51.118409 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bfa310f6-7d23-4e7a-b247-a00886fa933b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:51.159700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-bfa310f6-7d23-4e7a-b247-a00886fa933b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Going to try to stop instance {{(pid=125448) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 20 13:38:51.235386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-bfa310f6-7d23-4e7a-b247-a00886fa933b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/action" status: 202 len: 0 microversion: 2.1 time: 0.151404 Oct 20 13:38:51.236195 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 207/442] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:38:51 2022] POST /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:38:51.244792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0abe4104-acc0-44d2-a991-e85bf3e9f126 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:51.245454 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0abe4104-acc0-44d2-a991-e85bf3e9f126 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:51.254098 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0abe4104-acc0-44d2-a991-e85bf3e9f126 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:51.254760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0abe4104-acc0-44d2-a991-e85bf3e9f126 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:51.255315 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0abe4104-acc0-44d2-a991-e85bf3e9f126 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:51.256238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0abe4104-acc0-44d2-a991-e85bf3e9f126 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:51.256754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0abe4104-acc0-44d2-a991-e85bf3e9f126 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:51.257237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0abe4104-acc0-44d2-a991-e85bf3e9f126 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:51.278034 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:51.287570 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:51.289056 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:51.290406 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5d8b2e35-224e-424b-a928-e237a5614ac8 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1807 microversion: 2.20 time: 0.228174 Oct 20 13:38:51.305058 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 236/443] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:51 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:51.474053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0abe4104-acc0-44d2-a991-e85bf3e9f126 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:51.483450 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0abe4104-acc0-44d2-a991-e85bf3e9f126 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.242171 Oct 20 13:38:51.484813 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 208/444] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:51 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:51.659399 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-119419541", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80f8d646-52cd-4c79-be89-0476981cc6e9"}], "security_groups": [{"name": "tempest-securitygroup--407880188"}], "key_name": "tempest-keypair-1893496124", "user_data": "}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:51.775282 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.network.neutron [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] validate_networks() for [('80f8d646-52cd-4c79-be89-0476981cc6e9', None, None, None, None, None)] {{(pid=125447) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:38:52.157500 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Flavor limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:38:52.158074 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Image limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:38:52.158365 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Flavor pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:38:52.159346 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Image pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:38:52.159912 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:38:52.168492 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:52.169014 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:52.169444 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:52.170326 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:52.170981 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:52.171389 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:52.188795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Getting quotas for project f36e9fb394944eb0a0c2c0075dbc937c. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:38:52.192716 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Getting quotas for user 2dd45d3b097c46c28eb94c5e0bd2a7a6 and project f36e9fb394944eb0a0c2c0075dbc937c. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:38:52.203441 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Going to run 1 instances... {{(pid=125447) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:38:52.206090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125447) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:38:52.251808 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-251a93d0-aa2f-407b-b356-e691f2268c88 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.597244 Oct 20 13:38:52.252531 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 237/445] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:38:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 13:38:52.263336 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5484e255-d05a-4226-bc48-ee556308ed74 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:52.263941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5484e255-d05a-4226-bc48-ee556308ed74 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:52.316622 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:52.317694 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:52.317881 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5484e255-d05a-4226-bc48-ee556308ed74 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:52.324528 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:52.324974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5484e255-d05a-4226-bc48-ee556308ed74 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1245 microversion: 2.1 time: 0.065352 Oct 20 13:38:52.325157 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:52.325561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 209/446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:52 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1245 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:52.326052 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:52.326824 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:52.327284 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:52.327706 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:52.332317 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:52.464931 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:52.474161 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:52.475816 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:52.477014 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-03aa453f-00a1-445c-af49-01493a169b21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1794 microversion: 2.20 time: 0.164814 Oct 20 13:38:52.477586 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 238/447] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:38:52 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1794 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:38:52.508567 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d22f8c88-6d31-4443-9e1e-bef3a0b9d70c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:52.509373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d22f8c88-6d31-4443-9e1e-bef3a0b9d70c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:52.516501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d22f8c88-6d31-4443-9e1e-bef3a0b9d70c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:52.516770 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d22f8c88-6d31-4443-9e1e-bef3a0b9d70c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:52.517285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d22f8c88-6d31-4443-9e1e-bef3a0b9d70c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:52.518139 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d22f8c88-6d31-4443-9e1e-bef3a0b9d70c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:52.519229 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d22f8c88-6d31-4443-9e1e-bef3a0b9d70c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:52.519663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d22f8c88-6d31-4443-9e1e-bef3a0b9d70c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:52.657817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d22f8c88-6d31-4443-9e1e-bef3a0b9d70c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:52.666587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d22f8c88-6d31-4443-9e1e-bef3a0b9d70c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.161847 Oct 20 13:38:52.667149 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 210/448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:52 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:52.781179 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9466f6d4-676c-4e1e-93cd-fb2cd3d7ae4a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:52.781699 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9466f6d4-676c-4e1e-93cd-fb2cd3d7ae4a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:52.788224 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9466f6d4-676c-4e1e-93cd-fb2cd3d7ae4a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:52.788699 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9466f6d4-676c-4e1e-93cd-fb2cd3d7ae4a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:52.789162 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9466f6d4-676c-4e1e-93cd-fb2cd3d7ae4a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:52.789839 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9466f6d4-676c-4e1e-93cd-fb2cd3d7ae4a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:52.790288 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9466f6d4-676c-4e1e-93cd-fb2cd3d7ae4a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:52.790702 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9466f6d4-676c-4e1e-93cd-fb2cd3d7ae4a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:52.878822 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.objects.instance [None req-9466f6d4-676c-4e1e-93cd-fb2cd3d7ae4a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lazy-loading 'services' on Instance uuid 0787959c-f72a-4c43-9d8e-99727c31a00e {{(pid=125447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:38:52.952049 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9466f6d4-676c-4e1e-93cd-fb2cd3d7ae4a tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e/os-volume_attachments/359f5997-8f2c-4cae-8239-88e23b14a10c" status: 202 len: 0 microversion: 2.1 time: 0.174655 Oct 20 13:38:52.952634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 239/449] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:38:52 2022] DELETE /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e/os-volume_attachments/359f5997-8f2c-4cae-8239-88e23b14a10c => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:38:53.349546 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e00d2260-38d9-4dd4-870c-b1733c3b7e73 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:53.350160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e00d2260-38d9-4dd4-870c-b1733c3b7e73 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:53.356466 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00d2260-38d9-4dd4-870c-b1733c3b7e73 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:53.356975 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00d2260-38d9-4dd4-870c-b1733c3b7e73 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:53.357405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00d2260-38d9-4dd4-870c-b1733c3b7e73 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:53.358084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00d2260-38d9-4dd4-870c-b1733c3b7e73 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:53.358551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00d2260-38d9-4dd4-870c-b1733c3b7e73 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:53.358953 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e00d2260-38d9-4dd4-870c-b1733c3b7e73 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:53.421597 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e00d2260-38d9-4dd4-870c-b1733c3b7e73 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:53.429131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e00d2260-38d9-4dd4-870c-b1733c3b7e73 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1297 microversion: 2.1 time: 0.084223 Oct 20 13:38:53.429695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 211/450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:53 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:53.691247 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-87f3415d-ff91-4d18-9b9e-33af3333e70f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:53.691949 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-87f3415d-ff91-4d18-9b9e-33af3333e70f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:53.698558 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-87f3415d-ff91-4d18-9b9e-33af3333e70f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:53.699019 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-87f3415d-ff91-4d18-9b9e-33af3333e70f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:53.699450 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-87f3415d-ff91-4d18-9b9e-33af3333e70f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:53.700126 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-87f3415d-ff91-4d18-9b9e-33af3333e70f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:53.700575 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-87f3415d-ff91-4d18-9b9e-33af3333e70f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:53.701026 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-87f3415d-ff91-4d18-9b9e-33af3333e70f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:53.839380 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-87f3415d-ff91-4d18-9b9e-33af3333e70f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:53.847499 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-87f3415d-ff91-4d18-9b9e-33af3333e70f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.161092 Oct 20 13:38:53.848061 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 240/451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:53 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:54.451331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-66ee5a19-7e7c-48d0-95f5-6ed319b0ceb1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:54.451994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-66ee5a19-7e7c-48d0-95f5-6ed319b0ceb1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:54.458389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66ee5a19-7e7c-48d0-95f5-6ed319b0ceb1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:54.458882 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66ee5a19-7e7c-48d0-95f5-6ed319b0ceb1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:54.459315 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66ee5a19-7e7c-48d0-95f5-6ed319b0ceb1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:54.460006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66ee5a19-7e7c-48d0-95f5-6ed319b0ceb1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:54.460459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66ee5a19-7e7c-48d0-95f5-6ed319b0ceb1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:54.460899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66ee5a19-7e7c-48d0-95f5-6ed319b0ceb1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:54.535281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-66ee5a19-7e7c-48d0-95f5-6ed319b0ceb1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:54.543601 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-66ee5a19-7e7c-48d0-95f5-6ed319b0ceb1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1303 microversion: 2.1 time: 0.096116 Oct 20 13:38:54.544170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 212/452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:54 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:54.872445 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-515c1286-446a-4970-a963-1d971e0c8831 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:54.873386 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-515c1286-446a-4970-a963-1d971e0c8831 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:54.882183 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:54.884146 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-515c1286-446a-4970-a963-1d971e0c8831 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:54.884704 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-515c1286-446a-4970-a963-1d971e0c8831 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:54.885229 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-515c1286-446a-4970-a963-1d971e0c8831 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:54.886066 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-515c1286-446a-4970-a963-1d971e0c8831 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:54.886527 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-515c1286-446a-4970-a963-1d971e0c8831 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:54.887038 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-515c1286-446a-4970-a963-1d971e0c8831 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:55.048663 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-515c1286-446a-4970-a963-1d971e0c8831 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:55.060383 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-515c1286-446a-4970-a963-1d971e0c8831 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.192862 Oct 20 13:38:55.060962 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 241/453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:54 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:55.146627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2a8ffc2d-0cad-4b30-95cb-d20aa1e2a89b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:55.147127 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2a8ffc2d-0cad-4b30-95cb-d20aa1e2a89b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:55.155412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a8ffc2d-0cad-4b30-95cb-d20aa1e2a89b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:55.155914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a8ffc2d-0cad-4b30-95cb-d20aa1e2a89b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:55.157835 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a8ffc2d-0cad-4b30-95cb-d20aa1e2a89b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:55.159071 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a8ffc2d-0cad-4b30-95cb-d20aa1e2a89b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:55.160211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a8ffc2d-0cad-4b30-95cb-d20aa1e2a89b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:55.160647 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a8ffc2d-0cad-4b30-95cb-d20aa1e2a89b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:55.199374 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2a8ffc2d-0cad-4b30-95cb-d20aa1e2a89b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:38:55.308263 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2a8ffc2d-0cad-4b30-95cb-d20aa1e2a89b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 204 len: 0 microversion: 2.1 time: 0.165708 Oct 20 13:38:55.309309 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 213/454] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:38:55 2022] DELETE /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:38:55.318162 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-684ff456-f7dc-4d69-95d0-e6236792b3b9 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:55.319038 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-684ff456-f7dc-4d69-95d0-e6236792b3b9 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:55.325279 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-684ff456-f7dc-4d69-95d0-e6236792b3b9 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:55.326126 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-684ff456-f7dc-4d69-95d0-e6236792b3b9 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:55.326570 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-684ff456-f7dc-4d69-95d0-e6236792b3b9 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:55.327286 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-684ff456-f7dc-4d69-95d0-e6236792b3b9 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:55.327739 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-684ff456-f7dc-4d69-95d0-e6236792b3b9 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:55.328163 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-684ff456-f7dc-4d69-95d0-e6236792b3b9 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:55.481371 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-684ff456-f7dc-4d69-95d0-e6236792b3b9 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:55.489864 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-684ff456-f7dc-4d69-95d0-e6236792b3b9 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1513 microversion: 2.1 time: 0.176075 Oct 20 13:38:55.490884 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 242/455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:55 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:55.567964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a0a51731-d646-4beb-85bd-95da62b0280f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:55.568800 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a0a51731-d646-4beb-85bd-95da62b0280f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:55.575378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a0a51731-d646-4beb-85bd-95da62b0280f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:55.575866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a0a51731-d646-4beb-85bd-95da62b0280f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:55.576303 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a0a51731-d646-4beb-85bd-95da62b0280f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:55.577032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a0a51731-d646-4beb-85bd-95da62b0280f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:55.577482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a0a51731-d646-4beb-85bd-95da62b0280f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:55.577906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a0a51731-d646-4beb-85bd-95da62b0280f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:55.735593 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-b3116b53-aa9c-4c0c-ac7c-328cdef9b9e0 req-9d653e47-c264-4bf8-aad2-dd8140e32aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f326ad5-ca2f-4300-8676-2b6d7edfb108", "tag": "61a2cacd-9e95-4421-956a-22d6ee9a27a3"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:55.745528 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-b3116b53-aa9c-4c0c-ac7c-328cdef9b9e0 req-9d653e47-c264-4bf8-aad2-dd8140e32aa3 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:55.745987 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-b3116b53-aa9c-4c0c-ac7c-328cdef9b9e0 req-9d653e47-c264-4bf8-aad2-dd8140e32aa3 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:55.746479 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-b3116b53-aa9c-4c0c-ac7c-328cdef9b9e0 req-9d653e47-c264-4bf8-aad2-dd8140e32aa3 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:55.758540 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-b3116b53-aa9c-4c0c-ac7c-328cdef9b9e0 req-9d653e47-c264-4bf8-aad2-dd8140e32aa3 service nova] Creating event network-changed:61a2cacd-9e95-4421-956a-22d6ee9a27a3 for instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 on hv-cinder-86213 Oct 20 13:38:55.763509 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-b3116b53-aa9c-4c0c-ac7c-328cdef9b9e0 req-9d653e47-c264-4bf8-aad2-dd8140e32aa3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031626 Oct 20 13:38:55.764113 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 243/456] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:38:55.793798 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a0a51731-d646-4beb-85bd-95da62b0280f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:55.801820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a0a51731-d646-4beb-85bd-95da62b0280f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.238655 Oct 20 13:38:55.802401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 214/457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:55 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:56.085526 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7d727250-ca47-41ad-8f65-65130be4483f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:56.086265 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7d727250-ca47-41ad-8f65-65130be4483f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:56.093153 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7d727250-ca47-41ad-8f65-65130be4483f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:56.093641 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7d727250-ca47-41ad-8f65-65130be4483f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:56.094079 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7d727250-ca47-41ad-8f65-65130be4483f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:56.094767 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7d727250-ca47-41ad-8f65-65130be4483f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:56.095225 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7d727250-ca47-41ad-8f65-65130be4483f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:56.095656 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7d727250-ca47-41ad-8f65-65130be4483f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:56.226320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7d727250-ca47-41ad-8f65-65130be4483f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:56.233954 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7d727250-ca47-41ad-8f65-65130be4483f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.152705 Oct 20 13:38:56.234518 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 244/458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:56 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:56.515574 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d6b3fa38-1d2f-4464-ad41-b0fbe2730013 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:56.516187 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d6b3fa38-1d2f-4464-ad41-b0fbe2730013 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:56.522920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6b3fa38-1d2f-4464-ad41-b0fbe2730013 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:56.523399 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6b3fa38-1d2f-4464-ad41-b0fbe2730013 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:56.523836 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6b3fa38-1d2f-4464-ad41-b0fbe2730013 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:56.524519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6b3fa38-1d2f-4464-ad41-b0fbe2730013 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:56.524994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6b3fa38-1d2f-4464-ad41-b0fbe2730013 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:56.525418 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d6b3fa38-1d2f-4464-ad41-b0fbe2730013 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:56.651634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d6b3fa38-1d2f-4464-ad41-b0fbe2730013 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:56.659330 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d6b3fa38-1d2f-4464-ad41-b0fbe2730013 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1513 microversion: 2.1 time: 0.147617 Oct 20 13:38:56.659887 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 215/459] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:56 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:56.825107 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-060d8f4e-4887-4cf4-8c01-42e6dd51f48e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:56.826090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-060d8f4e-4887-4cf4-8c01-42e6dd51f48e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:56.832831 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-060d8f4e-4887-4cf4-8c01-42e6dd51f48e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:56.833355 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-060d8f4e-4887-4cf4-8c01-42e6dd51f48e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:56.833808 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-060d8f4e-4887-4cf4-8c01-42e6dd51f48e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:56.834498 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-060d8f4e-4887-4cf4-8c01-42e6dd51f48e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:56.834946 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-060d8f4e-4887-4cf4-8c01-42e6dd51f48e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:56.835368 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-060d8f4e-4887-4cf4-8c01-42e6dd51f48e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:56.960990 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-060d8f4e-4887-4cf4-8c01-42e6dd51f48e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:56.968540 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-060d8f4e-4887-4cf4-8c01-42e6dd51f48e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.147617 Oct 20 13:38:56.969131 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 245/460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:56 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:57.257682 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d87379b5-e500-44cb-8195-3416ceced318 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:57.258207 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d87379b5-e500-44cb-8195-3416ceced318 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:57.264240 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d87379b5-e500-44cb-8195-3416ceced318 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:57.264716 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d87379b5-e500-44cb-8195-3416ceced318 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:57.265176 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d87379b5-e500-44cb-8195-3416ceced318 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:57.265882 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d87379b5-e500-44cb-8195-3416ceced318 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:57.266325 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d87379b5-e500-44cb-8195-3416ceced318 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:57.266741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d87379b5-e500-44cb-8195-3416ceced318 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:57.398993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d87379b5-e500-44cb-8195-3416ceced318 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:57.406859 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d87379b5-e500-44cb-8195-3416ceced318 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.153030 Oct 20 13:38:57.407439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 216/461] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:57 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:57.682444 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-08b4f8dc-1caa-4abf-aa2d-06b30f4cdc51 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:57.683052 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-08b4f8dc-1caa-4abf-aa2d-06b30f4cdc51 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:57.689454 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-08b4f8dc-1caa-4abf-aa2d-06b30f4cdc51 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:57.690299 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-08b4f8dc-1caa-4abf-aa2d-06b30f4cdc51 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:57.690816 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-08b4f8dc-1caa-4abf-aa2d-06b30f4cdc51 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:57.691502 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-08b4f8dc-1caa-4abf-aa2d-06b30f4cdc51 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:57.691962 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-08b4f8dc-1caa-4abf-aa2d-06b30f4cdc51 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:57.692387 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-08b4f8dc-1caa-4abf-aa2d-06b30f4cdc51 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:57.825652 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-08b4f8dc-1caa-4abf-aa2d-06b30f4cdc51 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:57.834335 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-08b4f8dc-1caa-4abf-aa2d-06b30f4cdc51 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1513 microversion: 2.1 time: 0.155671 Oct 20 13:38:57.834907 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 246/462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:57 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:57.990275 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1617264e-0d6c-4a73-9581-343194bd428f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:57.990878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1617264e-0d6c-4a73-9581-343194bd428f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:57.997373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1617264e-0d6c-4a73-9581-343194bd428f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:57.997852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1617264e-0d6c-4a73-9581-343194bd428f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:57.998291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1617264e-0d6c-4a73-9581-343194bd428f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:57.998950 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1617264e-0d6c-4a73-9581-343194bd428f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:57.999637 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1617264e-0d6c-4a73-9581-343194bd428f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:58.000242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1617264e-0d6c-4a73-9581-343194bd428f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:58.431204 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d69f4a5b-9bee-4735-b6dd-d7cf8548b834 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:58.431830 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d69f4a5b-9bee-4735-b6dd-d7cf8548b834 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:58.437862 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d69f4a5b-9bee-4735-b6dd-d7cf8548b834 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:58.438350 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d69f4a5b-9bee-4735-b6dd-d7cf8548b834 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:58.438787 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d69f4a5b-9bee-4735-b6dd-d7cf8548b834 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:58.439483 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d69f4a5b-9bee-4735-b6dd-d7cf8548b834 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:58.440686 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d69f4a5b-9bee-4735-b6dd-d7cf8548b834 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:58.441139 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d69f4a5b-9bee-4735-b6dd-d7cf8548b834 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:58.481232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1617264e-0d6c-4a73-9581-343194bd428f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:58.508187 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1617264e-0d6c-4a73-9581-343194bd428f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.521262 Oct 20 13:38:58.509625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 217/463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:57 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:58.583836 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d69f4a5b-9bee-4735-b6dd-d7cf8548b834 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:58.591680 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d69f4a5b-9bee-4735-b6dd-d7cf8548b834 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.164497 Oct 20 13:38:58.592253 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 247/464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:58 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:58.860964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7c9f4487-57dd-4862-ac86-16d7805039c5 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:58.861876 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7c9f4487-57dd-4862-ac86-16d7805039c5 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:58.869853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c9f4487-57dd-4862-ac86-16d7805039c5 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:58.870335 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c9f4487-57dd-4862-ac86-16d7805039c5 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:58.870764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c9f4487-57dd-4862-ac86-16d7805039c5 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:58.871485 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c9f4487-57dd-4862-ac86-16d7805039c5 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:58.871973 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c9f4487-57dd-4862-ac86-16d7805039c5 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:58.872448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c9f4487-57dd-4862-ac86-16d7805039c5 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:58.895668 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-149bd774-c24e-4aea-b429-dbc9aea396fe req-ad69391f-05d9-415a-9e0a-56437883f0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0787959c-f72a-4c43-9d8e-99727c31a00e", "name": "network-vif-deleted", "tag": "48e38ca1-0978-43a8-a28f-176c07485795"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:38:58.905782 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-149bd774-c24e-4aea-b429-dbc9aea396fe req-ad69391f-05d9-415a-9e0a-56437883f0d2 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:58.906255 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-149bd774-c24e-4aea-b429-dbc9aea396fe req-ad69391f-05d9-415a-9e0a-56437883f0d2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:58.906708 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-149bd774-c24e-4aea-b429-dbc9aea396fe req-ad69391f-05d9-415a-9e0a-56437883f0d2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:58.918137 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-149bd774-c24e-4aea-b429-dbc9aea396fe req-ad69391f-05d9-415a-9e0a-56437883f0d2 service nova] Creating event network-vif-deleted:48e38ca1-0978-43a8-a28f-176c07485795 for instance 0787959c-f72a-4c43-9d8e-99727c31a00e on hv-cinder-86213 Oct 20 13:38:58.923121 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-149bd774-c24e-4aea-b429-dbc9aea396fe req-ad69391f-05d9-415a-9e0a-56437883f0d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031831 Oct 20 13:38:58.924200 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 248/465] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:38:58.940316 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7c9f4487-57dd-4862-ac86-16d7805039c5 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:58.943849 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:58.948954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7c9f4487-57dd-4862-ac86-16d7805039c5 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1471 microversion: 2.1 time: 0.094327 Oct 20 13:38:58.949500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 218/466] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:58 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:59.532021 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-49963efe-39ad-4a5c-a252-cab240745cd7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:59.532723 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-49963efe-39ad-4a5c-a252-cab240745cd7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:59.539687 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-49963efe-39ad-4a5c-a252-cab240745cd7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:59.540169 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-49963efe-39ad-4a5c-a252-cab240745cd7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:59.540599 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-49963efe-39ad-4a5c-a252-cab240745cd7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:59.541314 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-49963efe-39ad-4a5c-a252-cab240745cd7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:59.541768 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-49963efe-39ad-4a5c-a252-cab240745cd7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:59.542189 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-49963efe-39ad-4a5c-a252-cab240745cd7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:59.616820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-aca9d59f-1c14-4319-81fd-f19499460a44 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:59.617451 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-aca9d59f-1c14-4319-81fd-f19499460a44 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:59.625104 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aca9d59f-1c14-4319-81fd-f19499460a44 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:59.625596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aca9d59f-1c14-4319-81fd-f19499460a44 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:59.626026 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aca9d59f-1c14-4319-81fd-f19499460a44 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:59.626743 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aca9d59f-1c14-4319-81fd-f19499460a44 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:59.627269 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aca9d59f-1c14-4319-81fd-f19499460a44 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:59.627760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aca9d59f-1c14-4319-81fd-f19499460a44 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:59.682587 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-49963efe-39ad-4a5c-a252-cab240745cd7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:59.690431 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-49963efe-39ad-4a5c-a252-cab240745cd7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.162469 Oct 20 13:38:59.691162 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 249/467] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:59 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:38:59.763497 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-aca9d59f-1c14-4319-81fd-f19499460a44 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:38:59.771296 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-aca9d59f-1c14-4319-81fd-f19499460a44 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.160046 Oct 20 13:38:59.771848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 219/468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:59 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:38:59.973023 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-27aafa63-002f-4e87-987e-8edfcc2aff34 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:38:59.973562 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-27aafa63-002f-4e87-987e-8edfcc2aff34 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:38:59.979859 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-27aafa63-002f-4e87-987e-8edfcc2aff34 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:59.980332 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-27aafa63-002f-4e87-987e-8edfcc2aff34 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:59.980762 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-27aafa63-002f-4e87-987e-8edfcc2aff34 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:38:59.981461 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-27aafa63-002f-4e87-987e-8edfcc2aff34 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:38:59.981907 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-27aafa63-002f-4e87-987e-8edfcc2aff34 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:38:59.982323 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-27aafa63-002f-4e87-987e-8edfcc2aff34 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:00.043678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-27aafa63-002f-4e87-987e-8edfcc2aff34 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:00.051531 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-27aafa63-002f-4e87-987e-8edfcc2aff34 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 200 len: 1471 microversion: 2.1 time: 0.083002 Oct 20 13:39:00.052086 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 250/469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:38:59 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:00.712247 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-42c45d84-1d43-4afc-833c-a7d19613ef48 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:00.712856 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-42c45d84-1d43-4afc-833c-a7d19613ef48 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:00.719341 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42c45d84-1d43-4afc-833c-a7d19613ef48 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:00.719815 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42c45d84-1d43-4afc-833c-a7d19613ef48 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:00.720242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42c45d84-1d43-4afc-833c-a7d19613ef48 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:00.721473 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42c45d84-1d43-4afc-833c-a7d19613ef48 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:00.721929 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42c45d84-1d43-4afc-833c-a7d19613ef48 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:00.722356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42c45d84-1d43-4afc-833c-a7d19613ef48 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:00.794450 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-48e2b4b0-d60b-4b9e-b209-9947a3b33f6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:00.795271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-48e2b4b0-d60b-4b9e-b209-9947a3b33f6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:00.802546 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-48e2b4b0-d60b-4b9e-b209-9947a3b33f6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:00.803039 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-48e2b4b0-d60b-4b9e-b209-9947a3b33f6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:00.803479 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-48e2b4b0-d60b-4b9e-b209-9947a3b33f6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:00.804168 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-48e2b4b0-d60b-4b9e-b209-9947a3b33f6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:00.804621 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-48e2b4b0-d60b-4b9e-b209-9947a3b33f6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:00.805083 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-48e2b4b0-d60b-4b9e-b209-9947a3b33f6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:00.856605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-42c45d84-1d43-4afc-833c-a7d19613ef48 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:00.865240 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-42c45d84-1d43-4afc-833c-a7d19613ef48 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.156759 Oct 20 13:39:00.865820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 220/470] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:00 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:00.942283 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-48e2b4b0-d60b-4b9e-b209-9947a3b33f6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:00.950181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-48e2b4b0-d60b-4b9e-b209-9947a3b33f6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.159598 Oct 20 13:39:00.950768 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 251/471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:00 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:01.074660 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:01.075276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 0787959c-f72a-4c43-9d8e-99727c31a00e] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:01.081820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:01.082298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:01.082733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:01.083420 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:01.083871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:01.084293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:01.098047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] HTTP exception thrown: Instance 0787959c-f72a-4c43-9d8e-99727c31a00e could not be found. Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Request method failure captured: Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e HTTP/1.1 Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU8pTRsAh6F7Z5j7YMIKToQNTgPP4pQPV43nnN04M_JJBvHLugvPDaLmhcLON4SqK6zrDonPWrWJXV8hzuLGNmb_c7wBv29MERlKJOI3SZoTEqnsyeDxL_2u5s79TWk12SHFL_w4O8Jw2xrqoAdysJP6NuS-443k6gvdyEc6mDMIhjM Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: c189090d654b46c880b0d40f1e46a563 Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2039420125 Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:39:01.099652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c189090d654b46c880b0d40f1e46a563"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c189090d654b46c880b0d40f1e46a563"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c189090d654b46c880b0d40f1e46a563"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c189090d654b46c880b0d40f1e46a563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesSnapshotTestJSON-2039420125 Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: c189090d654b46c880b0d40f1e46a563 Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2039420125 Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesSnapshotTestJSON-2039420125-project Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 41c8c7437dd9443d8ddf4d10d8da6758 Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesSnapshotTestJSON-2039420125-project Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 0787959c-f72a-4c43-9d8e-99727c31a00e could not be found. Oct 20 13:39:01.101233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '0787959c-f72a-4c43-9d8e-99727c31a00e'} Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0787959c-f72a-4c43-9d8e-99727c31a00e could not be found. Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:39:01.102304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0787959c-f72a-4c43-9d8e-99727c31a00e could not be found. Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0787959c-f72a-4c43-9d8e-99727c31a00e could not be found. Oct 20 13:39:01.103763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:39:01.105057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Returning 404 to user: Instance 0787959c-f72a-4c43-9d8e-99727c31a00e could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:39:01.105057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-84c6ca96-b3c5-4c1c-89ed-8ea781483f7d tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e" status: 404 len: 111 microversion: 2.1 time: 0.030228 Oct 20 13:39:01.105057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 221/472] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:01 2022] GET /compute/v2.1/servers/0787959c-f72a-4c43-9d8e-99727c31a00e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:39:01.888562 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e30e5d30-a86f-4431-80ed-345150d853c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:01.889231 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e30e5d30-a86f-4431-80ed-345150d853c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:01.895771 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e30e5d30-a86f-4431-80ed-345150d853c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:01.896255 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e30e5d30-a86f-4431-80ed-345150d853c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:01.896692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e30e5d30-a86f-4431-80ed-345150d853c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:01.897413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e30e5d30-a86f-4431-80ed-345150d853c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:01.897906 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e30e5d30-a86f-4431-80ed-345150d853c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:01.898319 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e30e5d30-a86f-4431-80ed-345150d853c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:01.973469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-af1e9b1f-0822-4343-b363-141fdef10956 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:01.974081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-af1e9b1f-0822-4343-b363-141fdef10956 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:01.980668 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1e9b1f-0822-4343-b363-141fdef10956 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:01.981063 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1e9b1f-0822-4343-b363-141fdef10956 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:01.981496 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1e9b1f-0822-4343-b363-141fdef10956 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:01.982181 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1e9b1f-0822-4343-b363-141fdef10956 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:01.982628 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1e9b1f-0822-4343-b363-141fdef10956 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:01.983050 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af1e9b1f-0822-4343-b363-141fdef10956 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:02.032729 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e30e5d30-a86f-4431-80ed-345150d853c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:02.040366 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e30e5d30-a86f-4431-80ed-345150d853c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.155639 Oct 20 13:39:02.041038 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 252/473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:01 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:02.112419 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-af1e9b1f-0822-4343-b363-141fdef10956 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:02.120126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-af1e9b1f-0822-4343-b363-141fdef10956 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.150696 Oct 20 13:39:02.120681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 222/474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:01 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:03.064072 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f1ade1b6-57cd-4507-a9d6-1aea940267c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:03.065271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-f1ade1b6-57cd-4507-a9d6-1aea940267c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:03.067244 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=2 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:03.067902 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=6 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:03.074773 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1ade1b6-57cd-4507-a9d6-1aea940267c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:03.075252 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1ade1b6-57cd-4507-a9d6-1aea940267c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:03.075686 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1ade1b6-57cd-4507-a9d6-1aea940267c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:03.076371 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1ade1b6-57cd-4507-a9d6-1aea940267c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:03.076824 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1ade1b6-57cd-4507-a9d6-1aea940267c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:03.077276 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-f1ade1b6-57cd-4507-a9d6-1aea940267c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:03.144551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-20a9dc9c-29dc-4748-9ebb-70ec4fe6edd6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:03.145885 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-20a9dc9c-29dc-4748-9ebb-70ec4fe6edd6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:03.147787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=6 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:03.153756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a9dc9c-29dc-4748-9ebb-70ec4fe6edd6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:03.154238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a9dc9c-29dc-4748-9ebb-70ec4fe6edd6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:03.154683 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a9dc9c-29dc-4748-9ebb-70ec4fe6edd6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:03.155362 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a9dc9c-29dc-4748-9ebb-70ec4fe6edd6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:03.155817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a9dc9c-29dc-4748-9ebb-70ec4fe6edd6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:03.156243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a9dc9c-29dc-4748-9ebb-70ec4fe6edd6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:03.205003 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-f1ade1b6-57cd-4507-a9d6-1aea940267c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:03.213197 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-f1ade1b6-57cd-4507-a9d6-1aea940267c7 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.153005 Oct 20 13:39:03.213765 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 253/475] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:03 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:03.286029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-20a9dc9c-29dc-4748-9ebb-70ec4fe6edd6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:03.293746 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-20a9dc9c-29dc-4748-9ebb-70ec4fe6edd6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.154167 Oct 20 13:39:03.294305 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 223/476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:03 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:04.236046 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-69e4b770-0a91-4570-8db4-61170660e5af tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:04.237079 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-69e4b770-0a91-4570-8db4-61170660e5af tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:04.243498 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-69e4b770-0a91-4570-8db4-61170660e5af tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:04.243979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-69e4b770-0a91-4570-8db4-61170660e5af tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:04.244414 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-69e4b770-0a91-4570-8db4-61170660e5af tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:04.245122 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-69e4b770-0a91-4570-8db4-61170660e5af tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:04.245578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-69e4b770-0a91-4570-8db4-61170660e5af tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:04.246004 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-69e4b770-0a91-4570-8db4-61170660e5af tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:04.316803 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a299ef94-8f8d-486f-95ed-6682f023a8ef tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:04.317534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a299ef94-8f8d-486f-95ed-6682f023a8ef tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:04.324150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a299ef94-8f8d-486f-95ed-6682f023a8ef tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:04.324567 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a299ef94-8f8d-486f-95ed-6682f023a8ef tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:04.325036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a299ef94-8f8d-486f-95ed-6682f023a8ef tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:04.325728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a299ef94-8f8d-486f-95ed-6682f023a8ef tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:04.326175 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a299ef94-8f8d-486f-95ed-6682f023a8ef tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:04.326592 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a299ef94-8f8d-486f-95ed-6682f023a8ef tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:04.384614 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-69e4b770-0a91-4570-8db4-61170660e5af tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:04.392306 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-69e4b770-0a91-4570-8db4-61170660e5af tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.160126 Oct 20 13:39:04.394025 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 254/477] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:04 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:04.460558 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a299ef94-8f8d-486f-95ed-6682f023a8ef tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:04.468121 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a299ef94-8f8d-486f-95ed-6682f023a8ef tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.155246 Oct 20 13:39:04.468688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 224/478] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:04 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:05.415861 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7ae6b45f-8310-4bd0-84ad-383d49025fe3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:05.416504 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7ae6b45f-8310-4bd0-84ad-383d49025fe3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:05.422823 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7ae6b45f-8310-4bd0-84ad-383d49025fe3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:05.423300 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7ae6b45f-8310-4bd0-84ad-383d49025fe3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:05.424263 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7ae6b45f-8310-4bd0-84ad-383d49025fe3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:05.424483 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7ae6b45f-8310-4bd0-84ad-383d49025fe3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:05.424959 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7ae6b45f-8310-4bd0-84ad-383d49025fe3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:05.425377 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7ae6b45f-8310-4bd0-84ad-383d49025fe3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:05.443722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:05.491832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-83666002-1a86-457f-96b8-73499842b0a8 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:05.492347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-83666002-1a86-457f-96b8-73499842b0a8 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:05.499112 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-83666002-1a86-457f-96b8-73499842b0a8 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:05.499671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-83666002-1a86-457f-96b8-73499842b0a8 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:05.500167 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-83666002-1a86-457f-96b8-73499842b0a8 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:05.501013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-83666002-1a86-457f-96b8-73499842b0a8 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:05.501280 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-83666002-1a86-457f-96b8-73499842b0a8 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:05.502259 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-83666002-1a86-457f-96b8-73499842b0a8 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:05.566614 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7ae6b45f-8310-4bd0-84ad-383d49025fe3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:05.574545 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7ae6b45f-8310-4bd0-84ad-383d49025fe3 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.162423 Oct 20 13:39:05.575114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 255/479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:05 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:05.650246 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-83666002-1a86-457f-96b8-73499842b0a8 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:05.658921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-83666002-1a86-457f-96b8-73499842b0a8 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.170257 Oct 20 13:39:05.659843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 225/480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:05 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:06.454333 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-f5e9e891-9048-4504-8221-09589b792181 req-312939d7-9da5-4fa8-82e8-0243fd213580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f326ad5-ca2f-4300-8676-2b6d7edfb108", "name": "network-vif-plugged", "status": "completed", "tag": "61a2cacd-9e95-4421-956a-22d6ee9a27a3"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:06.464940 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-f5e9e891-9048-4504-8221-09589b792181 req-312939d7-9da5-4fa8-82e8-0243fd213580 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:06.465427 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-f5e9e891-9048-4504-8221-09589b792181 req-312939d7-9da5-4fa8-82e8-0243fd213580 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:06.465837 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-f5e9e891-9048-4504-8221-09589b792181 req-312939d7-9da5-4fa8-82e8-0243fd213580 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:06.477357 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-f5e9e891-9048-4504-8221-09589b792181 req-312939d7-9da5-4fa8-82e8-0243fd213580 service nova] Creating event network-vif-plugged:61a2cacd-9e95-4421-956a-22d6ee9a27a3 for instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 on hv-cinder-86213 Oct 20 13:39:06.482214 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-f5e9e891-9048-4504-8221-09589b792181 req-312939d7-9da5-4fa8-82e8-0243fd213580 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031563 Oct 20 13:39:06.482795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 256/481] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:06.598776 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c7c598cc-3f31-41c4-8633-9c93535dfd64 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:06.599555 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c7c598cc-3f31-41c4-8633-9c93535dfd64 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:06.605741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7c598cc-3f31-41c4-8633-9c93535dfd64 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:06.606353 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7c598cc-3f31-41c4-8633-9c93535dfd64 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:06.606807 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7c598cc-3f31-41c4-8633-9c93535dfd64 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:06.607473 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7c598cc-3f31-41c4-8633-9c93535dfd64 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:06.607924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7c598cc-3f31-41c4-8633-9c93535dfd64 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:06.608345 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7c598cc-3f31-41c4-8633-9c93535dfd64 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:06.685847 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-732e0871-2881-4a02-9fa5-06c6bf905e97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:06.686552 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-732e0871-2881-4a02-9fa5-06c6bf905e97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:06.694484 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-732e0871-2881-4a02-9fa5-06c6bf905e97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:06.695173 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-732e0871-2881-4a02-9fa5-06c6bf905e97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:06.695605 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-732e0871-2881-4a02-9fa5-06c6bf905e97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:06.696456 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-732e0871-2881-4a02-9fa5-06c6bf905e97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:06.697114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-732e0871-2881-4a02-9fa5-06c6bf905e97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:06.697541 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-732e0871-2881-4a02-9fa5-06c6bf905e97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:06.810273 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c7c598cc-3f31-41c4-8633-9c93535dfd64 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:06.826180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c7c598cc-3f31-41c4-8633-9c93535dfd64 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.231784 Oct 20 13:39:06.833414 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 226/482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:06 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:06.865761 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-732e0871-2881-4a02-9fa5-06c6bf905e97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:06.873414 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-732e0871-2881-4a02-9fa5-06c6bf905e97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.191828 Oct 20 13:39:06.873975 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 257/483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:06 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:07.849821 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8d315c36-046b-4e87-8a8b-b8465eed218a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:07.850425 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8d315c36-046b-4e87-8a8b-b8465eed218a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:07.858378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d315c36-046b-4e87-8a8b-b8465eed218a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:07.858861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d315c36-046b-4e87-8a8b-b8465eed218a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:07.859296 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d315c36-046b-4e87-8a8b-b8465eed218a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:07.859986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d315c36-046b-4e87-8a8b-b8465eed218a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:07.860439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d315c36-046b-4e87-8a8b-b8465eed218a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:07.860882 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d315c36-046b-4e87-8a8b-b8465eed218a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:07.897867 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0ee057f1-8891-4530-ab6d-eaa47ec4defd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:07.898579 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0ee057f1-8891-4530-ab6d-eaa47ec4defd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:07.905170 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee057f1-8891-4530-ab6d-eaa47ec4defd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:07.905727 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee057f1-8891-4530-ab6d-eaa47ec4defd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:07.906225 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee057f1-8891-4530-ab6d-eaa47ec4defd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:07.906977 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee057f1-8891-4530-ab6d-eaa47ec4defd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:07.907513 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee057f1-8891-4530-ab6d-eaa47ec4defd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:07.907996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee057f1-8891-4530-ab6d-eaa47ec4defd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:07.991403 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8d315c36-046b-4e87-8a8b-b8465eed218a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:07.999040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8d315c36-046b-4e87-8a8b-b8465eed218a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.153388 Oct 20 13:39:08.000186 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 227/484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:07 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:08.038560 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0ee057f1-8891-4530-ab6d-eaa47ec4defd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:08.046175 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0ee057f1-8891-4530-ab6d-eaa47ec4defd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.152071 Oct 20 13:39:08.046771 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 258/485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:07 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:09.022879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b305a51f-d8bd-4a65-aac5-e58f36127b01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:09.023495 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b305a51f-d8bd-4a65-aac5-e58f36127b01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:09.029888 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b305a51f-d8bd-4a65-aac5-e58f36127b01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:09.030371 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b305a51f-d8bd-4a65-aac5-e58f36127b01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:09.030804 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b305a51f-d8bd-4a65-aac5-e58f36127b01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:09.031487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b305a51f-d8bd-4a65-aac5-e58f36127b01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:09.031940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b305a51f-d8bd-4a65-aac5-e58f36127b01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:09.032360 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b305a51f-d8bd-4a65-aac5-e58f36127b01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:09.069942 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-409b3c1f-ce64-48be-b5dc-d157aac606fc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:09.070553 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-409b3c1f-ce64-48be-b5dc-d157aac606fc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:09.076915 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-409b3c1f-ce64-48be-b5dc-d157aac606fc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:09.077413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-409b3c1f-ce64-48be-b5dc-d157aac606fc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:09.077847 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-409b3c1f-ce64-48be-b5dc-d157aac606fc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:09.078545 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-409b3c1f-ce64-48be-b5dc-d157aac606fc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:09.079000 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-409b3c1f-ce64-48be-b5dc-d157aac606fc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:09.079425 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-409b3c1f-ce64-48be-b5dc-d157aac606fc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:09.160439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b305a51f-d8bd-4a65-aac5-e58f36127b01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:09.168289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b305a51f-d8bd-4a65-aac5-e58f36127b01 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.149157 Oct 20 13:39:09.169092 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 228/486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:09 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:09.207070 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-409b3c1f-ce64-48be-b5dc-d157aac606fc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:09.214591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-409b3c1f-ce64-48be-b5dc-d157aac606fc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1676 microversion: 2.1 time: 0.148420 Oct 20 13:39:09.215157 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 259/487] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:09 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:10.050913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-277187935", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "networks": [{"uuid": "3d74f2a6-396d-4af0-8172-d2ba2f2834fd"}]}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:10.104894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.network.neutron [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] validate_networks() for [('3d74f2a6-396d-4af0-8172-d2ba2f2834fd', None, None, None, None, None)] {{(pid=125448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:39:10.192179 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9e6cb951-2864-40fb-b6c8-055addcd4fb5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:10.192806 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9e6cb951-2864-40fb-b6c8-055addcd4fb5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:10.199199 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e6cb951-2864-40fb-b6c8-055addcd4fb5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.199918 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e6cb951-2864-40fb-b6c8-055addcd4fb5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.200357 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e6cb951-2864-40fb-b6c8-055addcd4fb5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.201084 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e6cb951-2864-40fb-b6c8-055addcd4fb5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.201537 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e6cb951-2864-40fb-b6c8-055addcd4fb5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.201958 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e6cb951-2864-40fb-b6c8-055addcd4fb5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.334906 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9e6cb951-2864-40fb-b6c8-055addcd4fb5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:10.342736 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9e6cb951-2864-40fb-b6c8-055addcd4fb5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.155000 Oct 20 13:39:10.343311 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 260/488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:10 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:10.347947 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9024cea3-6e3a-4f40-af8f-18363c3c0694 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:10.348443 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9024cea3-6e3a-4f40-af8f-18363c3c0694 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:10.354216 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9024cea3-6e3a-4f40-af8f-18363c3c0694 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.354971 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9024cea3-6e3a-4f40-af8f-18363c3c0694 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.355409 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9024cea3-6e3a-4f40-af8f-18363c3c0694 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.356282 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9024cea3-6e3a-4f40-af8f-18363c3c0694 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.356750 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9024cea3-6e3a-4f40-af8f-18363c3c0694 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.357283 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9024cea3-6e3a-4f40-af8f-18363c3c0694 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.382800 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9024cea3-6e3a-4f40-af8f-18363c3c0694 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051/ips" status: 200 len: 150 microversion: 2.1 time: 0.038455 Oct 20 13:39:10.383383 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 261/489] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 20 13:39:10 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:10.387669 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a3c70b7c-79de-4aea-8bc9-21da06fd7c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:10.388276 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a3c70b7c-79de-4aea-8bc9-21da06fd7c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:10.394744 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a3c70b7c-79de-4aea-8bc9-21da06fd7c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.395226 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a3c70b7c-79de-4aea-8bc9-21da06fd7c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.395660 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a3c70b7c-79de-4aea-8bc9-21da06fd7c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.396345 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a3c70b7c-79de-4aea-8bc9-21da06fd7c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.396799 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a3c70b7c-79de-4aea-8bc9-21da06fd7c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.397271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a3c70b7c-79de-4aea-8bc9-21da06fd7c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.460680 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Flavor limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:39:10.461245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Image limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:39:10.461720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Flavor pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:39:10.462152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Image pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:39:10.462560 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:39:10.464505 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:10.474474 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.474956 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.475389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.476112 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.476554 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.477007 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.495373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Getting quotas for project c189090d654b46c880b0d40f1e46a563. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:39:10.499756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Getting quotas for user 41c8c7437dd9443d8ddf4d10d8da6758 and project c189090d654b46c880b0d40f1e46a563. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:39:10.512632 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Going to run 1 instances... {{(pid=125448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:39:10.514995 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:39:10.532172 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a3c70b7c-79de-4aea-8bc9-21da06fd7c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:10.541601 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a3c70b7c-79de-4aea-8bc9-21da06fd7c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1653 microversion: 2.1 time: 0.157255 Oct 20 13:39:10.542261 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 262/490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:10 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1653 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:10.547960 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27bafbc1-b045-4130-bcdd-1bfb2fbed327"}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:10.551410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:10.557431 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.557993 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.558501 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.559286 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.559802 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.560398 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.564579 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f17ca909-6095-4e7e-b26e-057b1db4b951 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517907 Oct 20 13:39:10.565361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 229/491] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 13:39:10.570267 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9b4b771c-092f-4e71-9fd4-522e89d92eac tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:10.577365 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9b4b771c-092f-4e71-9fd4-522e89d92eac tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.577836 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9b4b771c-092f-4e71-9fd4-522e89d92eac tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.578277 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9b4b771c-092f-4e71-9fd4-522e89d92eac tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.600954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9b4b771c-092f-4e71-9fd4-522e89d92eac tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Going to try to start instance {{(pid=125448) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 20 13:39:10.647765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9b4b771c-092f-4e71-9fd4-522e89d92eac tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/action" status: 202 len: 0 microversion: 2.1 time: 0.080852 Oct 20 13:39:10.648482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 230/492] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:39:10 2022] POST /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:39:10.654448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0cffd1fc-bc18-410e-bea1-e5d9ac20d11b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:10.655213 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0cffd1fc-bc18-410e-bea1-e5d9ac20d11b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:10.662380 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Invalid volume: volume 27bafbc1-b045-4130-bcdd-1bfb2fbed327 is already attached to instances: a07ca6e8-83ee-4690-97c1-7cc13774d5ea Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: POST /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051/os-volume_attachments HTTP/1.1 Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 74 Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:39:10.665292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {"volumeAttachment": {"volumeId": "27bafbc1-b045-4130-bcdd-1bfb2fbed327"}} Oct 20 13:39:10.667013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: > Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Invalid volume: volume 27bafbc1-b045-4130-bcdd-1bfb2fbed327 is already attached to instances: a07ca6e8-83ee-4690-97c1-7cc13774d5ea Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'server_id': 'f4fc63ee-55ed-437c-81f4-4d658bf32051', 'body': {'volumeAttachment': {'volumeId': '27bafbc1-b045-4130-bcdd-1bfb2fbed327'}}} Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 27bafbc1-b045-4130-bcdd-1bfb2fbed327 is already attached to instances: a07ca6e8-83ee-4690-97c1-7cc13774d5ea Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:10.667885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 27bafbc1-b045-4130-bcdd-1bfb2fbed327 is already attached to instances: a07ca6e8-83ee-4690-97c1-7cc13774d5ea Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:10.669610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:39:10.671082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:39:10.671082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:39:10.671082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:39:10.671082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 27bafbc1-b045-4130-bcdd-1bfb2fbed327 is already attached to instances: a07ca6e8-83ee-4690-97c1-7cc13774d5ea Oct 20 13:39:10.671082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:10.671082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 400 to user: Invalid volume: volume 27bafbc1-b045-4130-bcdd-1bfb2fbed327 is already attached to instances: a07ca6e8-83ee-4690-97c1-7cc13774d5ea {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:39:10.671082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e763ab83-70e1-4f02-9ff0-a93e7655bf1d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123434 Oct 20 13:39:10.671082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 263/493] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:39:10 2022] POST /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 13:39:10.672405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d055287b-7223-486a-91ca-a59a26642d22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:10.673102 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d055287b-7223-486a-91ca-a59a26642d22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:10.685938 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d055287b-7223-486a-91ca-a59a26642d22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.686464 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d055287b-7223-486a-91ca-a59a26642d22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.686956 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d055287b-7223-486a-91ca-a59a26642d22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.687676 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d055287b-7223-486a-91ca-a59a26642d22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.688134 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d055287b-7223-486a-91ca-a59a26642d22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.688567 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d055287b-7223-486a-91ca-a59a26642d22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.728695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0cffd1fc-bc18-410e-bea1-e5d9ac20d11b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:10.735998 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0cffd1fc-bc18-410e-bea1-e5d9ac20d11b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1218 microversion: 2.1 time: 0.085937 Oct 20 13:39:10.736584 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 231/494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:10 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:10.741414 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-02e9fa5b-21fa-42df-8094-9c67786fdc22 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:10.741907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-02e9fa5b-21fa-42df-8094-9c67786fdc22 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:10.747814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e9fa5b-21fa-42df-8094-9c67786fdc22 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.748295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e9fa5b-21fa-42df-8094-9c67786fdc22 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.748749 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e9fa5b-21fa-42df-8094-9c67786fdc22 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.749718 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e9fa5b-21fa-42df-8094-9c67786fdc22 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.750173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e9fa5b-21fa-42df-8094-9c67786fdc22 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.750597 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e9fa5b-21fa-42df-8094-9c67786fdc22 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.788920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-02e9fa5b-21fa-42df-8094-9c67786fdc22 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:39:10.860270 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d055287b-7223-486a-91ca-a59a26642d22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:10.871817 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d055287b-7223-486a-91ca-a59a26642d22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1662 microversion: 2.1 time: 0.203480 Oct 20 13:39:10.872528 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 264/495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:10 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1662 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:10.876091 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-02e9fa5b-21fa-42df-8094-9c67786fdc22 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 204 len: 0 microversion: 2.1 time: 0.137928 Oct 20 13:39:10.877483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 232/496] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:39:10 2022] DELETE /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:39:10.895884 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a970b3d1-9b2c-4275-8486-f0eee34aa4e0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:10.896497 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a970b3d1-9b2c-4275-8486-f0eee34aa4e0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:10.902295 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a970b3d1-9b2c-4275-8486-f0eee34aa4e0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.902778 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a970b3d1-9b2c-4275-8486-f0eee34aa4e0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.903202 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a970b3d1-9b2c-4275-8486-f0eee34aa4e0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:10.903891 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a970b3d1-9b2c-4275-8486-f0eee34aa4e0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:10.904339 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a970b3d1-9b2c-4275-8486-f0eee34aa4e0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:10.904753 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a970b3d1-9b2c-4275-8486-f0eee34aa4e0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:11.041316 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a970b3d1-9b2c-4275-8486-f0eee34aa4e0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:11.050040 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a970b3d1-9b2c-4275-8486-f0eee34aa4e0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1682 microversion: 2.1 time: 0.164959 Oct 20 13:39:11.050600 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 265/497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:10 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:11.367480 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3fc2fb2d-f38e-4b4d-8156-581dae795c5c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:11.368235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3fc2fb2d-f38e-4b4d-8156-581dae795c5c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:11.375101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3fc2fb2d-f38e-4b4d-8156-581dae795c5c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:11.375585 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3fc2fb2d-f38e-4b4d-8156-581dae795c5c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:11.376046 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3fc2fb2d-f38e-4b4d-8156-581dae795c5c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:11.377038 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3fc2fb2d-f38e-4b4d-8156-581dae795c5c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:11.377226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3fc2fb2d-f38e-4b4d-8156-581dae795c5c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:11.377649 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3fc2fb2d-f38e-4b4d-8156-581dae795c5c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:11.516670 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3fc2fb2d-f38e-4b4d-8156-581dae795c5c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:11.524460 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3fc2fb2d-f38e-4b4d-8156-581dae795c5c tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1370 microversion: 2.1 time: 0.161214 Oct 20 13:39:11.525068 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 233/498] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:11 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:11.759038 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e11f49ef-5145-40c1-8e84-57305eef0398 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:11.759587 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e11f49ef-5145-40c1-8e84-57305eef0398 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:11.766091 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e11f49ef-5145-40c1-8e84-57305eef0398 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:11.768094 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e11f49ef-5145-40c1-8e84-57305eef0398 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:11.768549 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e11f49ef-5145-40c1-8e84-57305eef0398 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:11.769272 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e11f49ef-5145-40c1-8e84-57305eef0398 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:11.769727 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e11f49ef-5145-40c1-8e84-57305eef0398 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:11.770146 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e11f49ef-5145-40c1-8e84-57305eef0398 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:11.829405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e11f49ef-5145-40c1-8e84-57305eef0398 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:11.837955 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e11f49ef-5145-40c1-8e84-57305eef0398 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1222 microversion: 2.1 time: 0.082874 Oct 20 13:39:11.838513 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 266/499] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:11 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:11.897053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cd4c85d5-98ee-4192-8137-e041e1df2cee tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:11.897686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cd4c85d5-98ee-4192-8137-e041e1df2cee tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:11.903563 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd4c85d5-98ee-4192-8137-e041e1df2cee tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:11.904040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd4c85d5-98ee-4192-8137-e041e1df2cee tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:11.904526 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd4c85d5-98ee-4192-8137-e041e1df2cee tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:11.905272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd4c85d5-98ee-4192-8137-e041e1df2cee tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:11.905801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd4c85d5-98ee-4192-8137-e041e1df2cee tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:11.906264 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd4c85d5-98ee-4192-8137-e041e1df2cee tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:12.035733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd4c85d5-98ee-4192-8137-e041e1df2cee tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:12.043231 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cd4c85d5-98ee-4192-8137-e041e1df2cee tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1662 microversion: 2.1 time: 0.150275 Oct 20 13:39:12.043784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 234/500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:11 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:12.073475 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-4d226440-db9f-4881-9629-5c270dfddb12 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:12.074079 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-4d226440-db9f-4881-9629-5c270dfddb12 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:12.080651 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d226440-db9f-4881-9629-5c270dfddb12 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:12.081151 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d226440-db9f-4881-9629-5c270dfddb12 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:12.081580 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d226440-db9f-4881-9629-5c270dfddb12 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:12.082259 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d226440-db9f-4881-9629-5c270dfddb12 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:12.082712 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d226440-db9f-4881-9629-5c270dfddb12 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:12.083125 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d226440-db9f-4881-9629-5c270dfddb12 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:12.212711 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-4d226440-db9f-4881-9629-5c270dfddb12 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:12.220344 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-4d226440-db9f-4881-9629-5c270dfddb12 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1682 microversion: 2.1 time: 0.150661 Oct 20 13:39:12.220942 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 267/501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:12 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:12.547394 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7db1e1e6-bd6b-430e-b42b-06c7eec98b49 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:12.547993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7db1e1e6-bd6b-430e-b42b-06c7eec98b49 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:12.555115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7db1e1e6-bd6b-430e-b42b-06c7eec98b49 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:12.555611 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7db1e1e6-bd6b-430e-b42b-06c7eec98b49 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:12.556037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7db1e1e6-bd6b-430e-b42b-06c7eec98b49 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:12.556709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7db1e1e6-bd6b-430e-b42b-06c7eec98b49 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:12.557184 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7db1e1e6-bd6b-430e-b42b-06c7eec98b49 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:12.557595 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7db1e1e6-bd6b-430e-b42b-06c7eec98b49 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:12.561625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:12.685860 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7db1e1e6-bd6b-430e-b42b-06c7eec98b49 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:12.694417 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7db1e1e6-bd6b-430e-b42b-06c7eec98b49 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1564 microversion: 2.1 time: 0.150876 Oct 20 13:39:12.694982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 235/502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:12 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:12.716457 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-01465df6-d2ed-4baa-b1db-7777aa45fbc4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:12.717081 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-01465df6-d2ed-4baa-b1db-7777aa45fbc4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:12.723672 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-01465df6-d2ed-4baa-b1db-7777aa45fbc4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:12.724157 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-01465df6-d2ed-4baa-b1db-7777aa45fbc4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:12.724595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-01465df6-d2ed-4baa-b1db-7777aa45fbc4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:12.725318 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-01465df6-d2ed-4baa-b1db-7777aa45fbc4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:12.725776 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-01465df6-d2ed-4baa-b1db-7777aa45fbc4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:12.726204 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-01465df6-d2ed-4baa-b1db-7777aa45fbc4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:12.805106 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-01465df6-d2ed-4baa-b1db-7777aa45fbc4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092405 Oct 20 13:39:12.805708 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 268/503] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 20 13:39:12 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:12.863060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5ffb0adc-6928-48bd-80ab-974c05e69edf tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:12.865196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5ffb0adc-6928-48bd-80ab-974c05e69edf tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:12.875433 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ffb0adc-6928-48bd-80ab-974c05e69edf tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:12.876279 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ffb0adc-6928-48bd-80ab-974c05e69edf tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:12.877428 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ffb0adc-6928-48bd-80ab-974c05e69edf tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:12.878289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ffb0adc-6928-48bd-80ab-974c05e69edf tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:12.878896 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ffb0adc-6928-48bd-80ab-974c05e69edf tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:12.879473 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ffb0adc-6928-48bd-80ab-974c05e69edf tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:12.998921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5ffb0adc-6928-48bd-80ab-974c05e69edf tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:13.007211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5ffb0adc-6928-48bd-80ab-974c05e69edf tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1222 microversion: 2.1 time: 0.149410 Oct 20 13:39:13.022585 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 236/504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:12 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:13.067192 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e44a6574-7132-4730-94cb-cd84fc2d60dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:13.068491 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e44a6574-7132-4730-94cb-cd84fc2d60dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:13.074289 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e44a6574-7132-4730-94cb-cd84fc2d60dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:13.074783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e44a6574-7132-4730-94cb-cd84fc2d60dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:13.075223 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e44a6574-7132-4730-94cb-cd84fc2d60dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:13.075972 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e44a6574-7132-4730-94cb-cd84fc2d60dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:13.076386 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e44a6574-7132-4730-94cb-cd84fc2d60dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:13.076842 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e44a6574-7132-4730-94cb-cd84fc2d60dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:13.244558 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1099711e-65a6-4189-8bb0-2027e0adff99 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:13.245366 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1099711e-65a6-4189-8bb0-2027e0adff99 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:13.252704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1099711e-65a6-4189-8bb0-2027e0adff99 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:13.252984 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1099711e-65a6-4189-8bb0-2027e0adff99 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:13.253413 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1099711e-65a6-4189-8bb0-2027e0adff99 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:13.254098 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1099711e-65a6-4189-8bb0-2027e0adff99 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:13.254543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1099711e-65a6-4189-8bb0-2027e0adff99 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:13.255025 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1099711e-65a6-4189-8bb0-2027e0adff99 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:13.331060 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-e44a6574-7132-4730-94cb-cd84fc2d60dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:13.344941 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e44a6574-7132-4730-94cb-cd84fc2d60dd tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1662 microversion: 2.1 time: 0.282641 Oct 20 13:39:13.365283 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 269/505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:13 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1662 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:13.540641 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1099711e-65a6-4189-8bb0-2027e0adff99 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:13.553169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1099711e-65a6-4189-8bb0-2027e0adff99 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1682 microversion: 2.1 time: 0.312535 Oct 20 13:39:13.559416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 237/506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:13 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1682 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:14.029852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-86453cd3-dff8-4a9d-9faa-a40946ee0dfc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:14.031218 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-86453cd3-dff8-4a9d-9faa-a40946ee0dfc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:14.038716 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-86453cd3-dff8-4a9d-9faa-a40946ee0dfc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:14.039516 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-86453cd3-dff8-4a9d-9faa-a40946ee0dfc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:14.040181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-86453cd3-dff8-4a9d-9faa-a40946ee0dfc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:14.041128 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-86453cd3-dff8-4a9d-9faa-a40946ee0dfc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:14.041785 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-86453cd3-dff8-4a9d-9faa-a40946ee0dfc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:14.042407 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-86453cd3-dff8-4a9d-9faa-a40946ee0dfc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:14.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-86453cd3-dff8-4a9d-9faa-a40946ee0dfc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:14.174378 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-86453cd3-dff8-4a9d-9faa-a40946ee0dfc tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1278 microversion: 2.1 time: 0.144680 Oct 20 13:39:14.177534 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 270/507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:14 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:14.178078 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-76d1b706-d579-4462-aff5-6090a23f9b86 req-865004e8-16e8-4e9b-b4c3-0a68cea7868d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f326ad5-ca2f-4300-8676-2b6d7edfb108", "tag": "61a2cacd-9e95-4421-956a-22d6ee9a27a3"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:14.200454 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-76d1b706-d579-4462-aff5-6090a23f9b86 req-865004e8-16e8-4e9b-b4c3-0a68cea7868d service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:14.201351 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-76d1b706-d579-4462-aff5-6090a23f9b86 req-865004e8-16e8-4e9b-b4c3-0a68cea7868d service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:14.201994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-76d1b706-d579-4462-aff5-6090a23f9b86 req-865004e8-16e8-4e9b-b4c3-0a68cea7868d service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:14.218011 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-76d1b706-d579-4462-aff5-6090a23f9b86 req-865004e8-16e8-4e9b-b4c3-0a68cea7868d service nova] Creating event network-changed:61a2cacd-9e95-4421-956a-22d6ee9a27a3 for instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 on hv-cinder-86213 Oct 20 13:39:14.224248 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-76d1b706-d579-4462-aff5-6090a23f9b86 req-865004e8-16e8-4e9b-b4c3-0a68cea7868d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052217 Oct 20 13:39:14.225262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 238/508] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:39:14.368099 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-66b61186-b477-4372-a91e-d6ad0ca27bcb tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:14.368954 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-66b61186-b477-4372-a91e-d6ad0ca27bcb tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:14.375674 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66b61186-b477-4372-a91e-d6ad0ca27bcb tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:14.376171 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66b61186-b477-4372-a91e-d6ad0ca27bcb tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:14.377638 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66b61186-b477-4372-a91e-d6ad0ca27bcb tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:14.378460 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66b61186-b477-4372-a91e-d6ad0ca27bcb tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:14.379507 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66b61186-b477-4372-a91e-d6ad0ca27bcb tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:14.379952 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-66b61186-b477-4372-a91e-d6ad0ca27bcb tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:14.550361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-66b61186-b477-4372-a91e-d6ad0ca27bcb tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:14.559939 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-66b61186-b477-4372-a91e-d6ad0ca27bcb tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1662 microversion: 2.1 time: 0.195729 Oct 20 13:39:14.560648 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 271/509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:14 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1662 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:14.582305 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3811739f-4c8b-4cb9-a045-617dfdfcb10f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:14.583018 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3811739f-4c8b-4cb9-a045-617dfdfcb10f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:14.589415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3811739f-4c8b-4cb9-a045-617dfdfcb10f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:14.590234 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3811739f-4c8b-4cb9-a045-617dfdfcb10f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:14.590882 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3811739f-4c8b-4cb9-a045-617dfdfcb10f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:14.591797 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3811739f-4c8b-4cb9-a045-617dfdfcb10f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:14.592458 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3811739f-4c8b-4cb9-a045-617dfdfcb10f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:14.593116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3811739f-4c8b-4cb9-a045-617dfdfcb10f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:14.747331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3811739f-4c8b-4cb9-a045-617dfdfcb10f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:14.760366 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3811739f-4c8b-4cb9-a045-617dfdfcb10f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1614 microversion: 2.1 time: 0.182716 Oct 20 13:39:14.761867 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 239/510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:14 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1614 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:15.141555 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-bf8bb646-bfc8-496e-97ad-0970defe8f97 req-00d02236-f0dd-4e96-8ee8-0f6de4d9879f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4fc63ee-55ed-437c-81f4-4d658bf32051", "name": "network-vif-deleted", "tag": "bdeef6a2-1b0c-458c-adee-98e42b80b14c"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:15.161933 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-bf8bb646-bfc8-496e-97ad-0970defe8f97 req-00d02236-f0dd-4e96-8ee8-0f6de4d9879f service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:15.162786 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-bf8bb646-bfc8-496e-97ad-0970defe8f97 req-00d02236-f0dd-4e96-8ee8-0f6de4d9879f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:15.163476 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-bf8bb646-bfc8-496e-97ad-0970defe8f97 req-00d02236-f0dd-4e96-8ee8-0f6de4d9879f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:15.197826 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-bf8bb646-bfc8-496e-97ad-0970defe8f97 req-00d02236-f0dd-4e96-8ee8-0f6de4d9879f service nova] Creating event network-vif-deleted:bdeef6a2-1b0c-458c-adee-98e42b80b14c for instance f4fc63ee-55ed-437c-81f4-4d658bf32051 on hv-cinder-86213 Oct 20 13:39:15.200123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-62af4c52-11e6-471a-a7d7-6743c509c815 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:15.200747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-62af4c52-11e6-471a-a7d7-6743c509c815 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:15.209859 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-bf8bb646-bfc8-496e-97ad-0970defe8f97 req-00d02236-f0dd-4e96-8ee8-0f6de4d9879f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072186 Oct 20 13:39:15.212164 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 272/511] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:15.213827 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-62af4c52-11e6-471a-a7d7-6743c509c815 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:15.214553 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-62af4c52-11e6-471a-a7d7-6743c509c815 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:15.215235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-62af4c52-11e6-471a-a7d7-6743c509c815 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:15.216162 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-62af4c52-11e6-471a-a7d7-6743c509c815 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:15.216848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-62af4c52-11e6-471a-a7d7-6743c509c815 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:15.217668 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-62af4c52-11e6-471a-a7d7-6743c509c815 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:15.587599 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-785f2d5b-8efd-4bb4-9cf9-71a0291e82a4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:15.588545 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-785f2d5b-8efd-4bb4-9cf9-71a0291e82a4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:15.599817 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-785f2d5b-8efd-4bb4-9cf9-71a0291e82a4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:15.603015 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-785f2d5b-8efd-4bb4-9cf9-71a0291e82a4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:15.607596 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-785f2d5b-8efd-4bb4-9cf9-71a0291e82a4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:15.612301 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-785f2d5b-8efd-4bb4-9cf9-71a0291e82a4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:15.613175 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-785f2d5b-8efd-4bb4-9cf9-71a0291e82a4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:15.613932 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-785f2d5b-8efd-4bb4-9cf9-71a0291e82a4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:15.800777 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-785f2d5b-8efd-4bb4-9cf9-71a0291e82a4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:15.811830 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-785f2d5b-8efd-4bb4-9cf9-71a0291e82a4 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1666 microversion: 2.1 time: 0.229393 Oct 20 13:39:15.812959 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 273/512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:15 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1666 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:15.826952 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:15.832697 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:15.846600 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:15.847320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:15.847950 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:15.848845 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:15.849517 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:15.850157 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:15.855317 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=100 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:15.858510 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-62af4c52-11e6-471a-a7d7-6743c509c815 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:15.872384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-62af4c52-11e6-471a-a7d7-6743c509c815 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1318 microversion: 2.1 time: 0.676123 Oct 20 13:39:15.874420 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 240/513] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:15 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:15.910326 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:15.910815 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:15.911257 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:15.911712 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.objects.instance [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lazy-loading 'fault' on Instance uuid f4fc63ee-55ed-437c-81f4-4d658bf32051 {{(pid=125447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:39:15.976044 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:15.984444 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-50112f5b-090d-416e-9554-90f63c6a97aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 200 len: 1331 microversion: 2.1 time: 0.169723 Oct 20 13:39:15.985723 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 274/514] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:15 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 1331 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:16.899789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7e533066-c0b4-4eb3-9d7f-bae9d4feec3b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:16.900473 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7e533066-c0b4-4eb3-9d7f-bae9d4feec3b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:16.909089 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e533066-c0b4-4eb3-9d7f-bae9d4feec3b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:16.909579 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e533066-c0b4-4eb3-9d7f-bae9d4feec3b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:16.910016 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e533066-c0b4-4eb3-9d7f-bae9d4feec3b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:16.910794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e533066-c0b4-4eb3-9d7f-bae9d4feec3b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:16.911243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e533066-c0b4-4eb3-9d7f-bae9d4feec3b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:16.911669 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e533066-c0b4-4eb3-9d7f-bae9d4feec3b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:17.007687 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:17.008398 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:17.014963 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:17.015513 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:17.016011 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:17.017289 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:17.017740 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:17.018155 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:17.033247 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 HTTP/1.1 Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 0 Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:39:17.035036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: > Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:39:17.036519 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'id': 'f4fc63ee-55ed-437c-81f4-4d658bf32051'} Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:39:17.037408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:39:17.038783 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:17.040098 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:39:17.040098 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-4b9ae268-e1fd-41e3-9e0a-e6bc65098afb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 404 len: 111 microversion: 2.1 time: 0.032728 Oct 20 13:39:17.040380 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 275/515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:17 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:39:17.044934 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-08884c64-9c08-49bb-8c50-3f47b20f5876 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '.version_select at 0x7ffa12ef3040>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:17.067479 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-08884c64-9c08-49bb-8c50-3f47b20f5876 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-741114834" status: 202 len: 0 microversion: 2.1 time: 0.026007 Oct 20 13:39:17.068065 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 276/516] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 20 13:39:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-741114834 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:39:17.155270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7e533066-c0b4-4eb3-9d7f-bae9d4feec3b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:17.164520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7e533066-c0b4-4eb3-9d7f-bae9d4feec3b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1318 microversion: 2.1 time: 0.268695 Oct 20 13:39:17.177111 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 241/517] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:16 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:17.242759 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-68c89ba9-0763-4493-938d-92eafd85e53f req-0c9b5222-c116-486d-a041-ccb93fdeea96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370db21c-b140-47ce-b86d-73159b9151c0", "tag": "33ea7c12-93c6-4153-99db-81b8ff7a47c7"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:17.256087 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-68c89ba9-0763-4493-938d-92eafd85e53f req-0c9b5222-c116-486d-a041-ccb93fdeea96 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:17.256502 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-68c89ba9-0763-4493-938d-92eafd85e53f req-0c9b5222-c116-486d-a041-ccb93fdeea96 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:17.256960 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-68c89ba9-0763-4493-938d-92eafd85e53f req-0c9b5222-c116-486d-a041-ccb93fdeea96 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:17.281757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-68c89ba9-0763-4493-938d-92eafd85e53f req-0c9b5222-c116-486d-a041-ccb93fdeea96 service nova] Creating event network-changed:33ea7c12-93c6-4153-99db-81b8ff7a47c7 for instance 370db21c-b140-47ce-b86d-73159b9151c0 on hv-cinder-86213 Oct 20 13:39:17.288495 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-68c89ba9-0763-4493-938d-92eafd85e53f req-0c9b5222-c116-486d-a041-ccb93fdeea96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049536 Oct 20 13:39:17.290503 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 277/518] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:39:17.759319 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0460380c-25c0-4e0b-b8e1-300042f8b30e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:17.759809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0460380c-25c0-4e0b-b8e1-300042f8b30e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:17.765765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0460380c-25c0-4e0b-b8e1-300042f8b30e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:17.766242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0460380c-25c0-4e0b-b8e1-300042f8b30e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:17.766728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0460380c-25c0-4e0b-b8e1-300042f8b30e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:17.767452 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0460380c-25c0-4e0b-b8e1-300042f8b30e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:17.767900 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0460380c-25c0-4e0b-b8e1-300042f8b30e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:17.768323 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0460380c-25c0-4e0b-b8e1-300042f8b30e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:17.890027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-0460380c-25c0-4e0b-b8e1-300042f8b30e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lazy-loading 'services' on Instance uuid a07ca6e8-83ee-4690-97c1-7cc13774d5ea {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:39:18.007914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0460380c-25c0-4e0b-b8e1-300042f8b30e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-volume_attachments/27bafbc1-b045-4130-bcdd-1bfb2fbed327" status: 202 len: 0 microversion: 2.1 time: 0.252324 Oct 20 13:39:18.008554 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 242/519] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:39:17 2022] DELETE /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-volume_attachments/27bafbc1-b045-4130-bcdd-1bfb2fbed327 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:39:18.017588 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-30531064-f26f-44a4-a45a-e0c078b8efc0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:18.019786 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-30531064-f26f-44a4-a45a-e0c078b8efc0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:18.026073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30531064-f26f-44a4-a45a-e0c078b8efc0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:18.026544 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30531064-f26f-44a4-a45a-e0c078b8efc0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:18.026974 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30531064-f26f-44a4-a45a-e0c078b8efc0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:18.027650 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30531064-f26f-44a4-a45a-e0c078b8efc0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:18.028092 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30531064-f26f-44a4-a45a-e0c078b8efc0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:18.028506 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30531064-f26f-44a4-a45a-e0c078b8efc0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:18.058150 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-30531064-f26f-44a4-a45a-e0c078b8efc0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Oct 20 13:39:18.058692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 278/520] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:39:18 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:18.190146 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-dfa4a382-ab8a-49af-adae-1fadc34de380 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:18.190836 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-dfa4a382-ab8a-49af-adae-1fadc34de380 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:18.197284 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dfa4a382-ab8a-49af-adae-1fadc34de380 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:18.197769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dfa4a382-ab8a-49af-adae-1fadc34de380 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:18.198204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dfa4a382-ab8a-49af-adae-1fadc34de380 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:18.198889 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dfa4a382-ab8a-49af-adae-1fadc34de380 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:18.199338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dfa4a382-ab8a-49af-adae-1fadc34de380 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:18.199754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dfa4a382-ab8a-49af-adae-1fadc34de380 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:18.331213 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-dfa4a382-ab8a-49af-adae-1fadc34de380 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:18.338653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-dfa4a382-ab8a-49af-adae-1fadc34de380 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1318 microversion: 2.1 time: 0.153229 Oct 20 13:39:18.339209 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 243/521] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:18 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:19.070919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7326f260-5657-479f-87c5-a9f9ad75644e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:19.073216 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7326f260-5657-479f-87c5-a9f9ad75644e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:19.080430 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7326f260-5657-479f-87c5-a9f9ad75644e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:19.080934 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7326f260-5657-479f-87c5-a9f9ad75644e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:19.081363 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7326f260-5657-479f-87c5-a9f9ad75644e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:19.082180 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7326f260-5657-479f-87c5-a9f9ad75644e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:19.082629 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7326f260-5657-479f-87c5-a9f9ad75644e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:19.083047 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7326f260-5657-479f-87c5-a9f9ad75644e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:19.113108 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7326f260-5657-479f-87c5-a9f9ad75644e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046087 Oct 20 13:39:19.113669 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 279/522] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:39:19 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:19.362031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-49e8aa99-9380-42a3-8396-e1352afe8b11 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:19.362638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-49e8aa99-9380-42a3-8396-e1352afe8b11 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:19.368934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49e8aa99-9380-42a3-8396-e1352afe8b11 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:19.369430 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49e8aa99-9380-42a3-8396-e1352afe8b11 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:19.369842 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49e8aa99-9380-42a3-8396-e1352afe8b11 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:19.370520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49e8aa99-9380-42a3-8396-e1352afe8b11 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:19.370959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49e8aa99-9380-42a3-8396-e1352afe8b11 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:19.371373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49e8aa99-9380-42a3-8396-e1352afe8b11 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:19.547256 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-49e8aa99-9380-42a3-8396-e1352afe8b11 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:19.556055 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-49e8aa99-9380-42a3-8396-e1352afe8b11 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1318 microversion: 2.1 time: 0.198403 Oct 20 13:39:19.556653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 244/523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:19 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:20.125720 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0a9216cd-81a9-4e99-be93-988a226389b5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:20.127904 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0a9216cd-81a9-4e99-be93-988a226389b5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:20.134341 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a9216cd-81a9-4e99-be93-988a226389b5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:20.134813 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a9216cd-81a9-4e99-be93-988a226389b5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:20.135241 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a9216cd-81a9-4e99-be93-988a226389b5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:20.135921 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a9216cd-81a9-4e99-be93-988a226389b5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:20.136365 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a9216cd-81a9-4e99-be93-988a226389b5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:20.136780 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a9216cd-81a9-4e99-be93-988a226389b5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:20.165501 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0a9216cd-81a9-4e99-be93-988a226389b5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043997 Oct 20 13:39:20.166035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 280/524] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:39:20 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 13:39:20.228515 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9245cf5a-acd3-4260-92e2-3fe2a09a7d06 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:20.229067 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9245cf5a-acd3-4260-92e2-3fe2a09a7d06 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:20.234927 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9245cf5a-acd3-4260-92e2-3fe2a09a7d06 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:20.235620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9245cf5a-acd3-4260-92e2-3fe2a09a7d06 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:20.236086 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9245cf5a-acd3-4260-92e2-3fe2a09a7d06 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:20.236762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9245cf5a-acd3-4260-92e2-3fe2a09a7d06 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:20.237242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9245cf5a-acd3-4260-92e2-3fe2a09a7d06 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:20.237663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9245cf5a-acd3-4260-92e2-3fe2a09a7d06 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:20.262501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9245cf5a-acd3-4260-92e2-3fe2a09a7d06 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:39:20.335667 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9245cf5a-acd3-4260-92e2-3fe2a09a7d06 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 204 len: 0 microversion: 2.1 time: 0.110666 Oct 20 13:39:20.336381 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 245/525] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:39:20 2022] DELETE /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:39:20.344290 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-78e14dc1-5a68-4453-a694-4dfdd1434407 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:20.345138 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-78e14dc1-5a68-4453-a694-4dfdd1434407 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:20.351281 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-78e14dc1-5a68-4453-a694-4dfdd1434407 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:20.351760 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-78e14dc1-5a68-4453-a694-4dfdd1434407 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:20.352187 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-78e14dc1-5a68-4453-a694-4dfdd1434407 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:20.352920 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-78e14dc1-5a68-4453-a694-4dfdd1434407 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:20.353368 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-78e14dc1-5a68-4453-a694-4dfdd1434407 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:20.353784 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-78e14dc1-5a68-4453-a694-4dfdd1434407 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:20.481916 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-78e14dc1-5a68-4453-a694-4dfdd1434407 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:20.489997 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-78e14dc1-5a68-4453-a694-4dfdd1434407 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1682 microversion: 2.1 time: 0.149479 Oct 20 13:39:20.490567 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 281/526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:20 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:20.582924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fbae1546-d677-4396-baa0-357912894a69 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:20.583613 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fbae1546-d677-4396-baa0-357912894a69 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:20.586779 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:20.591577 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbae1546-d677-4396-baa0-357912894a69 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:20.592053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbae1546-d677-4396-baa0-357912894a69 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:20.592491 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbae1546-d677-4396-baa0-357912894a69 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:20.593189 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbae1546-d677-4396-baa0-357912894a69 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:20.593633 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbae1546-d677-4396-baa0-357912894a69 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:20.594046 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbae1546-d677-4396-baa0-357912894a69 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:20.723996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fbae1546-d677-4396-baa0-357912894a69 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:20.731575 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fbae1546-d677-4396-baa0-357912894a69 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1318 microversion: 2.1 time: 0.154956 Oct 20 13:39:20.732140 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 246/527] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:20 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:21.513978 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6068c425-f5b2-4520-a927-89d52f600fde tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:21.514595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-6068c425-f5b2-4520-a927-89d52f600fde tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:21.521860 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6068c425-f5b2-4520-a927-89d52f600fde tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:21.522345 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6068c425-f5b2-4520-a927-89d52f600fde tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:21.522785 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6068c425-f5b2-4520-a927-89d52f600fde tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:21.523475 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6068c425-f5b2-4520-a927-89d52f600fde tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:21.523931 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6068c425-f5b2-4520-a927-89d52f600fde tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:21.524359 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6068c425-f5b2-4520-a927-89d52f600fde tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:21.657107 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-6068c425-f5b2-4520-a927-89d52f600fde tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:21.664777 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-6068c425-f5b2-4520-a927-89d52f600fde tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1682 microversion: 2.1 time: 0.154637 Oct 20 13:39:21.665398 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 282/528] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:21 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:21.754839 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-02e5499b-c21e-4272-a821-e4c8040818ea tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:21.755479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-02e5499b-c21e-4272-a821-e4c8040818ea tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:21.757337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=8 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:21.763109 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e5499b-c21e-4272-a821-e4c8040818ea tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:21.763585 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e5499b-c21e-4272-a821-e4c8040818ea tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:21.764011 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e5499b-c21e-4272-a821-e4c8040818ea tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:21.764717 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e5499b-c21e-4272-a821-e4c8040818ea tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:21.765186 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e5499b-c21e-4272-a821-e4c8040818ea tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:21.765603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02e5499b-c21e-4272-a821-e4c8040818ea tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:21.903641 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-02e5499b-c21e-4272-a821-e4c8040818ea tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:21.912164 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-02e5499b-c21e-4272-a821-e4c8040818ea tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1318 microversion: 2.1 time: 0.161173 Oct 20 13:39:21.919780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 247/529] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:21 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:22.566066 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-78ce9a61-117e-4291-8d0a-9a32893cbcfb req-1484190f-a3ca-435d-9193-0d276d8fb6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370db21c-b140-47ce-b86d-73159b9151c0", "name": "network-vif-plugged", "status": "completed", "tag": "33ea7c12-93c6-4153-99db-81b8ff7a47c7"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:22.575626 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-78ce9a61-117e-4291-8d0a-9a32893cbcfb req-1484190f-a3ca-435d-9193-0d276d8fb6e0 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:22.576471 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-78ce9a61-117e-4291-8d0a-9a32893cbcfb req-1484190f-a3ca-435d-9193-0d276d8fb6e0 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:22.576754 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-78ce9a61-117e-4291-8d0a-9a32893cbcfb req-1484190f-a3ca-435d-9193-0d276d8fb6e0 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:22.593636 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-78ce9a61-117e-4291-8d0a-9a32893cbcfb req-1484190f-a3ca-435d-9193-0d276d8fb6e0 service nova] Creating event network-vif-plugged:33ea7c12-93c6-4153-99db-81b8ff7a47c7 for instance 370db21c-b140-47ce-b86d-73159b9151c0 on hv-cinder-86213 Oct 20 13:39:22.601068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-78ce9a61-117e-4291-8d0a-9a32893cbcfb req-1484190f-a3ca-435d-9193-0d276d8fb6e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038232 Oct 20 13:39:22.603014 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 283/530] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:22.689095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-07443057-95cd-4575-a534-1aaf1fa7fee4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:22.690068 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-07443057-95cd-4575-a534-1aaf1fa7fee4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:22.696489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-07443057-95cd-4575-a534-1aaf1fa7fee4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:22.697303 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-07443057-95cd-4575-a534-1aaf1fa7fee4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:22.697880 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-07443057-95cd-4575-a534-1aaf1fa7fee4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:22.698693 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-07443057-95cd-4575-a534-1aaf1fa7fee4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:22.699238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-07443057-95cd-4575-a534-1aaf1fa7fee4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:22.699717 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-07443057-95cd-4575-a534-1aaf1fa7fee4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:22.936289 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-72b6e65b-075c-4a4c-8b9c-82015fce2b97 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:22.936925 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-72b6e65b-075c-4a4c-8b9c-82015fce2b97 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:22.944088 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72b6e65b-075c-4a4c-8b9c-82015fce2b97 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:22.944563 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72b6e65b-075c-4a4c-8b9c-82015fce2b97 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:22.945027 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72b6e65b-075c-4a4c-8b9c-82015fce2b97 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:22.945723 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72b6e65b-075c-4a4c-8b9c-82015fce2b97 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:22.946187 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72b6e65b-075c-4a4c-8b9c-82015fce2b97 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:22.946589 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-72b6e65b-075c-4a4c-8b9c-82015fce2b97 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:23.081919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-72b6e65b-075c-4a4c-8b9c-82015fce2b97 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:23.090104 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-72b6e65b-075c-4a4c-8b9c-82015fce2b97 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1318 microversion: 2.1 time: 0.158145 Oct 20 13:39:23.090684 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 284/531] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:22 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:23.211668 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-07443057-95cd-4575-a534-1aaf1fa7fee4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:23.219230 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-07443057-95cd-4575-a534-1aaf1fa7fee4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1682 microversion: 2.1 time: 0.534502 Oct 20 13:39:23.220456 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 248/532] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:22 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1682 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:23.584300 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-1eef1233-ee80-4a1c-a1ff-25473da5b53e req-5201f887-4e8a-46c1-a2cc-ba0042009aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07ca6e8-83ee-4690-97c1-7cc13774d5ea", "name": "network-vif-deleted", "tag": "945c0530-b30a-4e15-a586-dfaaa2fdd6ae"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:23.601683 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-1eef1233-ee80-4a1c-a1ff-25473da5b53e req-5201f887-4e8a-46c1-a2cc-ba0042009aa3 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:23.602261 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-1eef1233-ee80-4a1c-a1ff-25473da5b53e req-5201f887-4e8a-46c1-a2cc-ba0042009aa3 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:23.602751 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-1eef1233-ee80-4a1c-a1ff-25473da5b53e req-5201f887-4e8a-46c1-a2cc-ba0042009aa3 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:23.617760 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-1eef1233-ee80-4a1c-a1ff-25473da5b53e req-5201f887-4e8a-46c1-a2cc-ba0042009aa3 service nova] Creating event network-vif-deleted:945c0530-b30a-4e15-a586-dfaaa2fdd6ae for instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea on hv-cinder-86213 Oct 20 13:39:23.622654 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-1eef1233-ee80-4a1c-a1ff-25473da5b53e req-5201f887-4e8a-46c1-a2cc-ba0042009aa3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041917 Oct 20 13:39:23.623250 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 285/533] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:24.114048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8e7392e2-47e7-45c4-a5bb-9e3032c21905 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:24.114695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8e7392e2-47e7-45c4-a5bb-9e3032c21905 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:24.122165 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e7392e2-47e7-45c4-a5bb-9e3032c21905 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:24.123097 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e7392e2-47e7-45c4-a5bb-9e3032c21905 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:24.124154 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e7392e2-47e7-45c4-a5bb-9e3032c21905 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:24.124945 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e7392e2-47e7-45c4-a5bb-9e3032c21905 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:24.126325 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e7392e2-47e7-45c4-a5bb-9e3032c21905 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:24.126851 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e7392e2-47e7-45c4-a5bb-9e3032c21905 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:24.245363 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:24.246139 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:24.253239 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:24.253724 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:24.254158 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:24.254858 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:24.255312 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:24.255732 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:24.268075 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8e7392e2-47e7-45c4-a5bb-9e3032c21905 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:24.277045 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8e7392e2-47e7-45c4-a5bb-9e3032c21905 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1318 microversion: 2.1 time: 0.167075 Oct 20 13:39:24.277449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 249/534] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:24 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:24.299161 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:24.300083 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:24.300509 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:24.301164 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.objects.instance [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lazy-loading 'fault' on Instance uuid a07ca6e8-83ee-4690-97c1-7cc13774d5ea {{(pid=125447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:39:24.346585 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:24.355318 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a81fc694-3f88-4cdd-85a8-fa940d0cbc85 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1332 microversion: 2.1 time: 0.115385 Oct 20 13:39:24.355928 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 286/535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:24 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:25.300689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-941e4ac5-2df2-43bd-b5a6-04b387c5aaed tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:25.301271 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-941e4ac5-2df2-43bd-b5a6-04b387c5aaed tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:25.307662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-941e4ac5-2df2-43bd-b5a6-04b387c5aaed tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:25.308133 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-941e4ac5-2df2-43bd-b5a6-04b387c5aaed tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:25.308560 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-941e4ac5-2df2-43bd-b5a6-04b387c5aaed tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:25.309271 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-941e4ac5-2df2-43bd-b5a6-04b387c5aaed tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:25.309744 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-941e4ac5-2df2-43bd-b5a6-04b387c5aaed tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:25.310152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-941e4ac5-2df2-43bd-b5a6-04b387c5aaed tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:25.314710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:25.380850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:25.381595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:25.385146 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:25.388716 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:25.389260 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:25.389690 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:25.390462 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:25.390810 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:25.391228 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:25.423044 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:25.424650 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:25.424650 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:25.424650 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.objects.instance [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lazy-loading 'fault' on Instance uuid a07ca6e8-83ee-4690-97c1-7cc13774d5ea {{(pid=125447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:39:25.450281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-941e4ac5-2df2-43bd-b5a6-04b387c5aaed tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:25.459066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-941e4ac5-2df2-43bd-b5a6-04b387c5aaed tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1507 microversion: 2.1 time: 0.162354 Oct 20 13:39:25.466728 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:25.473321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 250/536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:25 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:25.475802 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0a818d86-c15f-4431-b8da-a756c8c965ad tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 200 len: 1332 microversion: 2.1 time: 0.100229 Oct 20 13:39:25.476879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 287/537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:25 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:25.488667 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a6ec3444-9feb-4016-a5de-4b4fc53c030c tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b402658-8eb1-4d04-9e8b-7afa6af3988d", "device": "/dev/sdb"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:25.492726 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a6ec3444-9feb-4016-a5de-4b4fc53c030c tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:25.499218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6ec3444-9feb-4016-a5de-4b4fc53c030c tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:25.499919 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6ec3444-9feb-4016-a5de-4b4fc53c030c tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:25.500119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6ec3444-9feb-4016-a5de-4b4fc53c030c tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:25.501453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6ec3444-9feb-4016-a5de-4b4fc53c030c tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:25.502063 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6ec3444-9feb-4016-a5de-4b4fc53c030c tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:25.502484 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6ec3444-9feb-4016-a5de-4b4fc53c030c tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:25.762431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a6ec3444-9feb-4016-a5de-4b4fc53c030c tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "POST /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280657 Oct 20 13:39:25.763024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 251/538] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:39:25 2022] POST /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:26.504027 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:26.505488 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:26.513938 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:26.514570 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:26.515023 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:26.515736 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:26.516191 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:26.516618 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:26.531341 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea HTTP/1.1 Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 0 Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:39:26.533453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: > Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:39:26.534888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'id': 'a07ca6e8-83ee-4690-97c1-7cc13774d5ea'} Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:39:26.535611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:39:26.536757 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:26.537850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:39:26.537850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-33f5e102-9b55-4f94-8481-74cc9dac3a54 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 404 len: 111 microversion: 2.1 time: 0.034922 Oct 20 13:39:26.537850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 288/539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:26 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:39:26.545044 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c1a553f8-377b-4dc2-9d20-7e98023606c4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '.version_select at 0x7ffa12da6790>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:26.566799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c1a553f8-377b-4dc2-9d20-7e98023606c4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884063730" status: 202 len: 0 microversion: 2.1 time: 0.026397 Oct 20 13:39:26.567384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 252/540] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 20 13:39:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884063730 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:39:27.180955 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0a778061-e01e-4da6-a530-b737c3eccc81 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: .version_select at 0x7ffa12d223a0>, body: {"keypair": {"name": "tempest-keypair-745065976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDzHR5ihx7Gvw1AfEitYsfOBF1KaAyToYoM2vUfsZNSd3azPgVyzwz25Ek3OWSfZAvnn33lTHN+o/1af5oA49IpMA5zhwY7KF7IoSN2vi8sOyVvk+jG47QbMNf5ry0TrQ=="}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:27.195828 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-0a778061-e01e-4da6-a530-b737c3eccc81 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for project b215cb88123a4851932dbf7dfa88f709. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:39:27.199628 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-0a778061-e01e-4da6-a530-b737c3eccc81 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for user 144e9801ac1f470083d11647652ccdf1 and project b215cb88123a4851932dbf7dfa88f709. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:39:27.221451 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0a778061-e01e-4da6-a530-b737c3eccc81 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044207 Oct 20 13:39:27.222022 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 289/541] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 20 13:39:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:28.471947 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-636186234", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a87efad-1518-4319-8b6e-3edd28303f86"}], "security_groups": [{"name": "tempest-securitygroup--703327507"}], "key_name": "tempest-keypair-745065976", "user_data": "}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:28.582838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.network.neutron [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] validate_networks() for [('6a87efad-1518-4319-8b6e-3edd28303f86', None, None, None, None, None)] {{(pid=125448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:39:28.947658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Flavor limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:39:28.948041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Image limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:39:28.948516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Flavor pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:39:28.948946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Image pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:39:28.949355 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:39:28.958747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:28.959222 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:28.959650 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:28.960376 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:28.960821 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:28.961265 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:28.979858 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for project b215cb88123a4851932dbf7dfa88f709. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:39:28.983840 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for user 144e9801ac1f470083d11647652ccdf1 and project b215cb88123a4851932dbf7dfa88f709. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:39:28.994820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Going to run 1 instances... {{(pid=125448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:39:28.997218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:39:29.044245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-05410929-465f-43a3-a7ae-227fa1d2a134 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.577698 Oct 20 13:39:29.044850 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 253/542] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:39:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 13:39:29.056207 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-641a9cbf-c56b-49e5-989b-af2b89b7f0c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:29.057067 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-641a9cbf-c56b-49e5-989b-af2b89b7f0c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:29.115081 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-641a9cbf-c56b-49e5-989b-af2b89b7f0c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:29.122919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-641a9cbf-c56b-49e5-989b-af2b89b7f0c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1240 microversion: 2.1 time: 0.070752 Oct 20 13:39:29.123471 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 290/543] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:29 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:30.146658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-af34cbbf-3974-4a06-8129-a42d9aaccacb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:30.147272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-af34cbbf-3974-4a06-8129-a42d9aaccacb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:30.153408 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af34cbbf-3974-4a06-8129-a42d9aaccacb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:30.153878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af34cbbf-3974-4a06-8129-a42d9aaccacb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:30.154302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af34cbbf-3974-4a06-8129-a42d9aaccacb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:30.154970 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af34cbbf-3974-4a06-8129-a42d9aaccacb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:30.155410 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af34cbbf-3974-4a06-8129-a42d9aaccacb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:30.155823 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-af34cbbf-3974-4a06-8129-a42d9aaccacb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:30.220501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-af34cbbf-3974-4a06-8129-a42d9aaccacb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:30.228134 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-af34cbbf-3974-4a06-8129-a42d9aaccacb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1292 microversion: 2.1 time: 0.085808 Oct 20 13:39:30.228702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 254/544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:30 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:31.251619 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d36743e2-427d-4739-9d97-f2297996e045 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:31.253181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d36743e2-427d-4739-9d97-f2297996e045 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:31.260239 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d36743e2-427d-4739-9d97-f2297996e045 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:31.260721 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d36743e2-427d-4739-9d97-f2297996e045 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:31.261201 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d36743e2-427d-4739-9d97-f2297996e045 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:31.261903 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d36743e2-427d-4739-9d97-f2297996e045 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:31.262352 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d36743e2-427d-4739-9d97-f2297996e045 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:31.262772 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d36743e2-427d-4739-9d97-f2297996e045 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:31.399305 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d36743e2-427d-4739-9d97-f2297996e045 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:31.407604 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d36743e2-427d-4739-9d97-f2297996e045 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.160079 Oct 20 13:39:31.408172 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 291/545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:31 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:31.804677 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-ea883501-3f55-4fdb-9275-a7f11c9191cf req-800ed560-081a-408d-b156-5d81168bd7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e3dc4f-68fd-40c3-a6db-6a36405b78b8", "tag": "ab360a6b-2b2e-4e3a-9f55-9efb2ef8c2f8"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:31.815148 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ea883501-3f55-4fdb-9275-a7f11c9191cf req-800ed560-081a-408d-b156-5d81168bd7f1 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:31.815638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ea883501-3f55-4fdb-9275-a7f11c9191cf req-800ed560-081a-408d-b156-5d81168bd7f1 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:31.816057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ea883501-3f55-4fdb-9275-a7f11c9191cf req-800ed560-081a-408d-b156-5d81168bd7f1 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:31.826788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-ea883501-3f55-4fdb-9275-a7f11c9191cf req-800ed560-081a-408d-b156-5d81168bd7f1 service nova] Creating event network-changed:ab360a6b-2b2e-4e3a-9f55-9efb2ef8c2f8 for instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 on hv-cinder-86213 Oct 20 13:39:31.831804 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-ea883501-3f55-4fdb-9275-a7f11c9191cf req-800ed560-081a-408d-b156-5d81168bd7f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030654 Oct 20 13:39:31.832432 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 255/546] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:32.432305 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-93170985-7c76-4350-a1f2-6fcb694a596f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:32.433370 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-93170985-7c76-4350-a1f2-6fcb694a596f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:32.441922 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-93170985-7c76-4350-a1f2-6fcb694a596f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:32.442649 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-93170985-7c76-4350-a1f2-6fcb694a596f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:32.443404 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-93170985-7c76-4350-a1f2-6fcb694a596f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:32.444186 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-93170985-7c76-4350-a1f2-6fcb694a596f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:32.444656 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-93170985-7c76-4350-a1f2-6fcb694a596f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:32.445120 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-93170985-7c76-4350-a1f2-6fcb694a596f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:32.591883 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-93170985-7c76-4350-a1f2-6fcb694a596f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:32.600284 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-93170985-7c76-4350-a1f2-6fcb694a596f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.174118 Oct 20 13:39:32.600879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 292/547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:32 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:33.624440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7707a4ae-1d14-461a-ae7b-eda97301d66d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:33.625158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7707a4ae-1d14-461a-ae7b-eda97301d66d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:33.631994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7707a4ae-1d14-461a-ae7b-eda97301d66d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:33.632459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7707a4ae-1d14-461a-ae7b-eda97301d66d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:33.632919 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7707a4ae-1d14-461a-ae7b-eda97301d66d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:33.633734 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7707a4ae-1d14-461a-ae7b-eda97301d66d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:33.634182 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7707a4ae-1d14-461a-ae7b-eda97301d66d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:33.634599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7707a4ae-1d14-461a-ae7b-eda97301d66d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:33.767300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7707a4ae-1d14-461a-ae7b-eda97301d66d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:33.774865 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7707a4ae-1d14-461a-ae7b-eda97301d66d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.155451 Oct 20 13:39:33.775450 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 256/548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:33 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:34.798526 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-13e82b92-4aea-4e75-8c2b-8a48fb9f7ae9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:34.799077 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-13e82b92-4aea-4e75-8c2b-8a48fb9f7ae9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:34.805677 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13e82b92-4aea-4e75-8c2b-8a48fb9f7ae9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:34.806160 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13e82b92-4aea-4e75-8c2b-8a48fb9f7ae9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:34.806590 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13e82b92-4aea-4e75-8c2b-8a48fb9f7ae9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:34.807269 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13e82b92-4aea-4e75-8c2b-8a48fb9f7ae9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:34.807717 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13e82b92-4aea-4e75-8c2b-8a48fb9f7ae9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:34.808133 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-13e82b92-4aea-4e75-8c2b-8a48fb9f7ae9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:34.935684 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-13e82b92-4aea-4e75-8c2b-8a48fb9f7ae9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:34.943329 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-13e82b92-4aea-4e75-8c2b-8a48fb9f7ae9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.149306 Oct 20 13:39:34.943892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 293/549] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:34 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:35.966611 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f1efa4a0-fb4e-48e9-b8fe-05d2974fdb14 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:35.967224 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f1efa4a0-fb4e-48e9-b8fe-05d2974fdb14 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:35.970226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:35.975739 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f1efa4a0-fb4e-48e9-b8fe-05d2974fdb14 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:35.976218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f1efa4a0-fb4e-48e9-b8fe-05d2974fdb14 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:35.976652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f1efa4a0-fb4e-48e9-b8fe-05d2974fdb14 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:35.977359 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f1efa4a0-fb4e-48e9-b8fe-05d2974fdb14 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:35.977831 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f1efa4a0-fb4e-48e9-b8fe-05d2974fdb14 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:35.978251 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f1efa4a0-fb4e-48e9-b8fe-05d2974fdb14 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:36.108920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f1efa4a0-fb4e-48e9-b8fe-05d2974fdb14 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:36.117895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f1efa4a0-fb4e-48e9-b8fe-05d2974fdb14 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.155146 Oct 20 13:39:36.118496 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 257/550] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:35 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:37.140239 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c7cd4f62-8afe-4de9-9b93-792e41cbf928 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:37.140841 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-c7cd4f62-8afe-4de9-9b93-792e41cbf928 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:37.147775 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7cd4f62-8afe-4de9-9b93-792e41cbf928 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:37.148248 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7cd4f62-8afe-4de9-9b93-792e41cbf928 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:37.148676 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7cd4f62-8afe-4de9-9b93-792e41cbf928 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:37.149385 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7cd4f62-8afe-4de9-9b93-792e41cbf928 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:37.149831 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7cd4f62-8afe-4de9-9b93-792e41cbf928 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:37.150249 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c7cd4f62-8afe-4de9-9b93-792e41cbf928 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:37.276334 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c7cd4f62-8afe-4de9-9b93-792e41cbf928 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:37.285278 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-c7cd4f62-8afe-4de9-9b93-792e41cbf928 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.148778 Oct 20 13:39:37.286102 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 294/551] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:37 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:38.308213 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-55f3c637-fb6e-45cc-bd85-557ebbc9b206 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:38.308818 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-55f3c637-fb6e-45cc-bd85-557ebbc9b206 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:38.315912 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55f3c637-fb6e-45cc-bd85-557ebbc9b206 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:38.316388 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55f3c637-fb6e-45cc-bd85-557ebbc9b206 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:38.316818 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55f3c637-fb6e-45cc-bd85-557ebbc9b206 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:38.317520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55f3c637-fb6e-45cc-bd85-557ebbc9b206 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:38.317964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55f3c637-fb6e-45cc-bd85-557ebbc9b206 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:38.318380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-55f3c637-fb6e-45cc-bd85-557ebbc9b206 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:38.446274 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-55f3c637-fb6e-45cc-bd85-557ebbc9b206 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:38.454045 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-55f3c637-fb6e-45cc-bd85-557ebbc9b206 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.149564 Oct 20 13:39:38.455200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 258/552] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:38 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:39.478235 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-bdb5dd19-91bc-4047-98ac-df91d28f65c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:39.478849 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-bdb5dd19-91bc-4047-98ac-df91d28f65c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:39.481190 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=6 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:39.486909 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd19-91bc-4047-98ac-df91d28f65c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:39.487390 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd19-91bc-4047-98ac-df91d28f65c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:39.487857 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd19-91bc-4047-98ac-df91d28f65c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:39.488545 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd19-91bc-4047-98ac-df91d28f65c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:39.489031 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd19-91bc-4047-98ac-df91d28f65c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:39.489458 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd19-91bc-4047-98ac-df91d28f65c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:39.619404 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-bdb5dd19-91bc-4047-98ac-df91d28f65c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:39.628137 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-bdb5dd19-91bc-4047-98ac-df91d28f65c8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.153739 Oct 20 13:39:39.628708 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 295/553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:39 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:40.651008 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-db13f56d-3083-45ad-a4bc-38b4457e6e74 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:40.651613 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-db13f56d-3083-45ad-a4bc-38b4457e6e74 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:40.653458 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:40.654252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=6 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:40.660469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db13f56d-3083-45ad-a4bc-38b4457e6e74 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:40.660965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db13f56d-3083-45ad-a4bc-38b4457e6e74 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:40.661390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db13f56d-3083-45ad-a4bc-38b4457e6e74 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:40.662083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db13f56d-3083-45ad-a4bc-38b4457e6e74 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:40.662515 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db13f56d-3083-45ad-a4bc-38b4457e6e74 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:40.662928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-db13f56d-3083-45ad-a4bc-38b4457e6e74 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:40.792211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-db13f56d-3083-45ad-a4bc-38b4457e6e74 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:40.800452 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-db13f56d-3083-45ad-a4bc-38b4457e6e74 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.153228 Oct 20 13:39:40.801041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 259/554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:40 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:41.823626 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b29ef7d7-1a2c-4794-81d4-b46c4eef21c0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:41.824145 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b29ef7d7-1a2c-4794-81d4-b46c4eef21c0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:41.830315 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29ef7d7-1a2c-4794-81d4-b46c4eef21c0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:41.830787 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29ef7d7-1a2c-4794-81d4-b46c4eef21c0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:41.831215 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29ef7d7-1a2c-4794-81d4-b46c4eef21c0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:41.831899 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29ef7d7-1a2c-4794-81d4-b46c4eef21c0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:41.832351 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29ef7d7-1a2c-4794-81d4-b46c4eef21c0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:41.832763 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29ef7d7-1a2c-4794-81d4-b46c4eef21c0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:41.836805 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=100 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:41.963591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b29ef7d7-1a2c-4794-81d4-b46c4eef21c0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:41.971790 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b29ef7d7-1a2c-4794-81d4-b46c4eef21c0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.152078 Oct 20 13:39:41.972597 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 296/555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:41 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:42.863580 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-5d6d1c7c-149f-41f6-8451-391fdf99eea4 req-4daaf2f7-e655-4b29-89ea-4293172b52a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e3dc4f-68fd-40c3-a6db-6a36405b78b8", "name": "network-vif-plugged", "status": "completed", "tag": "ab360a6b-2b2e-4e3a-9f55-9efb2ef8c2f8"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:42.875156 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-5d6d1c7c-149f-41f6-8451-391fdf99eea4 req-4daaf2f7-e655-4b29-89ea-4293172b52a6 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:42.875658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-5d6d1c7c-149f-41f6-8451-391fdf99eea4 req-4daaf2f7-e655-4b29-89ea-4293172b52a6 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:42.876085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-5d6d1c7c-149f-41f6-8451-391fdf99eea4 req-4daaf2f7-e655-4b29-89ea-4293172b52a6 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:42.887692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-5d6d1c7c-149f-41f6-8451-391fdf99eea4 req-4daaf2f7-e655-4b29-89ea-4293172b52a6 service nova] Creating event network-vif-plugged:ab360a6b-2b2e-4e3a-9f55-9efb2ef8c2f8 for instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 on hv-cinder-86213 Oct 20 13:39:42.892620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-5d6d1c7c-149f-41f6-8451-391fdf99eea4 req-4daaf2f7-e655-4b29-89ea-4293172b52a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032914 Oct 20 13:39:42.894048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 260/556] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:42.995996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d820e809-fc91-4796-b327-2ffc5cf4215f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:42.996614 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d820e809-fc91-4796-b327-2ffc5cf4215f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:43.004429 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d820e809-fc91-4796-b327-2ffc5cf4215f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:43.005458 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d820e809-fc91-4796-b327-2ffc5cf4215f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:43.006084 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d820e809-fc91-4796-b327-2ffc5cf4215f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:43.007025 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d820e809-fc91-4796-b327-2ffc5cf4215f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:43.007743 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d820e809-fc91-4796-b327-2ffc5cf4215f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:43.008342 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d820e809-fc91-4796-b327-2ffc5cf4215f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:43.145758 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d820e809-fc91-4796-b327-2ffc5cf4215f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:43.154510 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d820e809-fc91-4796-b327-2ffc5cf4215f tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.162515 Oct 20 13:39:43.155091 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 297/557] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:42 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:44.180059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5841bc31-c78e-4fd3-a4e2-8b633d9cdda0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:44.180752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5841bc31-c78e-4fd3-a4e2-8b633d9cdda0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:44.187304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5841bc31-c78e-4fd3-a4e2-8b633d9cdda0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:44.187776 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5841bc31-c78e-4fd3-a4e2-8b633d9cdda0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:44.188202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5841bc31-c78e-4fd3-a4e2-8b633d9cdda0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:44.188882 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5841bc31-c78e-4fd3-a4e2-8b633d9cdda0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:44.189343 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5841bc31-c78e-4fd3-a4e2-8b633d9cdda0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:44.189809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5841bc31-c78e-4fd3-a4e2-8b633d9cdda0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:44.318971 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5841bc31-c78e-4fd3-a4e2-8b633d9cdda0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:44.327735 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5841bc31-c78e-4fd3-a4e2-8b633d9cdda0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1365 microversion: 2.1 time: 0.153839 Oct 20 13:39:44.328703 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 261/558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:44 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:45.149067 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-83e0f205-4420-4b8f-a0bf-5ebf2bb01846 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:45.149575 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-83e0f205-4420-4b8f-a0bf-5ebf2bb01846 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:45.156030 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-83e0f205-4420-4b8f-a0bf-5ebf2bb01846 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:45.156504 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-83e0f205-4420-4b8f-a0bf-5ebf2bb01846 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:45.156956 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-83e0f205-4420-4b8f-a0bf-5ebf2bb01846 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:45.157634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-83e0f205-4420-4b8f-a0bf-5ebf2bb01846 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:45.158079 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-83e0f205-4420-4b8f-a0bf-5ebf2bb01846 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:45.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-83e0f205-4420-4b8f-a0bf-5ebf2bb01846 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:45.239581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.objects.instance [None req-83e0f205-4420-4b8f-a0bf-5ebf2bb01846 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lazy-loading 'services' on Instance uuid 370db21c-b140-47ce-b86d-73159b9151c0 {{(pid=125447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:39:45.310788 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-83e0f205-4420-4b8f-a0bf-5ebf2bb01846 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0/os-volume_attachments/3b402658-8eb1-4d04-9e8b-7afa6af3988d" status: 202 len: 0 microversion: 2.1 time: 0.165453 Oct 20 13:39:45.311434 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 298/559] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:39:45 2022] DELETE /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0/os-volume_attachments/3b402658-8eb1-4d04-9e8b-7afa6af3988d => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:39:45.352366 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3cf95b98-2d72-4ca0-b724-b106371313aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:45.353001 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3cf95b98-2d72-4ca0-b724-b106371313aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:45.360368 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cf95b98-2d72-4ca0-b724-b106371313aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:45.360852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cf95b98-2d72-4ca0-b724-b106371313aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:45.361400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cf95b98-2d72-4ca0-b724-b106371313aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:45.362142 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cf95b98-2d72-4ca0-b724-b106371313aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:45.362665 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cf95b98-2d72-4ca0-b724-b106371313aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:45.363134 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3cf95b98-2d72-4ca0-b724-b106371313aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:45.493837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3cf95b98-2d72-4ca0-b724-b106371313aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:45.501692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3cf95b98-2d72-4ca0-b724-b106371313aa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1554 microversion: 2.1 time: 0.153734 Oct 20 13:39:45.502303 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 262/560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:45 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:39:45.524694 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9f10f60b-661a-496e-aeb6-b37f08df35e4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:45.525298 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9f10f60b-661a-496e-aeb6-b37f08df35e4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:45.531672 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9f10f60b-661a-496e-aeb6-b37f08df35e4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:45.532187 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9f10f60b-661a-496e-aeb6-b37f08df35e4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:45.532673 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9f10f60b-661a-496e-aeb6-b37f08df35e4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:45.533415 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9f10f60b-661a-496e-aeb6-b37f08df35e4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:45.534907 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9f10f60b-661a-496e-aeb6-b37f08df35e4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:45.535396 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9f10f60b-661a-496e-aeb6-b37f08df35e4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:45.615596 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9f10f60b-661a-496e-aeb6-b37f08df35e4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095018 Oct 20 13:39:45.616186 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 299/561] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 20 13:39:45 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:46.439356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e3780f5e-1baf-4eb7-b8f0-65310b235f9e tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:46.440556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e3780f5e-1baf-4eb7-b8f0-65310b235f9e tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:46.447100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3780f5e-1baf-4eb7-b8f0-65310b235f9e tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:46.447658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3780f5e-1baf-4eb7-b8f0-65310b235f9e tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:46.448159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3780f5e-1baf-4eb7-b8f0-65310b235f9e tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:46.449635 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3780f5e-1baf-4eb7-b8f0-65310b235f9e tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:46.449635 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3780f5e-1baf-4eb7-b8f0-65310b235f9e tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:46.449916 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3780f5e-1baf-4eb7-b8f0-65310b235f9e tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:46.475293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e3780f5e-1baf-4eb7-b8f0-65310b235f9e tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:39:46.538322 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-69784783-8f67-4d95-a0f4-fb5cd3858ee4 req-0d5fd550-6a9d-401d-a732-ed289f15aade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e3dc4f-68fd-40c3-a6db-6a36405b78b8", "tag": "ab360a6b-2b2e-4e3a-9f55-9efb2ef8c2f8"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:46.548075 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-69784783-8f67-4d95-a0f4-fb5cd3858ee4 req-0d5fd550-6a9d-401d-a732-ed289f15aade service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:46.548553 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-69784783-8f67-4d95-a0f4-fb5cd3858ee4 req-0d5fd550-6a9d-401d-a732-ed289f15aade service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:46.549659 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-69784783-8f67-4d95-a0f4-fb5cd3858ee4 req-0d5fd550-6a9d-401d-a732-ed289f15aade service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:46.561939 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-69784783-8f67-4d95-a0f4-fb5cd3858ee4 req-0d5fd550-6a9d-401d-a732-ed289f15aade service nova] Creating event network-changed:ab360a6b-2b2e-4e3a-9f55-9efb2ef8c2f8 for instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 on hv-cinder-86213 Oct 20 13:39:46.567817 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-69784783-8f67-4d95-a0f4-fb5cd3858ee4 req-0d5fd550-6a9d-401d-a732-ed289f15aade service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034391 Oct 20 13:39:46.568536 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 300/562] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:39:46.572062 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e3780f5e-1baf-4eb7-b8f0-65310b235f9e tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 204 len: 0 microversion: 2.1 time: 0.133182 Oct 20 13:39:46.572816 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 263/563] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:39:46 2022] DELETE /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:39:46.581449 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-92e79cf9-a0f9-4bf0-bb68-bc72edb2f5f6 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:46.582151 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-92e79cf9-a0f9-4bf0-bb68-bc72edb2f5f6 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:46.588400 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-92e79cf9-a0f9-4bf0-bb68-bc72edb2f5f6 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:46.588932 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-92e79cf9-a0f9-4bf0-bb68-bc72edb2f5f6 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:46.589379 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-92e79cf9-a0f9-4bf0-bb68-bc72edb2f5f6 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:46.590082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-92e79cf9-a0f9-4bf0-bb68-bc72edb2f5f6 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:46.590538 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-92e79cf9-a0f9-4bf0-bb68-bc72edb2f5f6 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:46.590964 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-92e79cf9-a0f9-4bf0-bb68-bc72edb2f5f6 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:46.727793 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-92e79cf9-a0f9-4bf0-bb68-bc72edb2f5f6 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:46.735668 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-92e79cf9-a0f9-4bf0-bb68-bc72edb2f5f6 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1513 microversion: 2.1 time: 0.158350 Oct 20 13:39:46.736266 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 301/564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:46 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:47.759837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f7554eac-3d42-498b-b6cb-9a2925c0448b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:47.760582 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f7554eac-3d42-498b-b6cb-9a2925c0448b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:47.766911 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7554eac-3d42-498b-b6cb-9a2925c0448b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:47.767379 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7554eac-3d42-498b-b6cb-9a2925c0448b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:47.767807 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7554eac-3d42-498b-b6cb-9a2925c0448b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:47.768780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7554eac-3d42-498b-b6cb-9a2925c0448b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:47.769487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7554eac-3d42-498b-b6cb-9a2925c0448b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:47.769907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7554eac-3d42-498b-b6cb-9a2925c0448b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:47.901256 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f7554eac-3d42-498b-b6cb-9a2925c0448b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:47.909302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f7554eac-3d42-498b-b6cb-9a2925c0448b tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1513 microversion: 2.1 time: 0.153648 Oct 20 13:39:47.909856 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 264/565] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:47 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:48.935063 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-1781c16e-3187-4b77-9330-600207288efd tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:48.935933 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-1781c16e-3187-4b77-9330-600207288efd tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:48.943647 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1781c16e-3187-4b77-9330-600207288efd tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:48.944131 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1781c16e-3187-4b77-9330-600207288efd tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:48.944595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1781c16e-3187-4b77-9330-600207288efd tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:48.945377 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1781c16e-3187-4b77-9330-600207288efd tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:48.945822 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1781c16e-3187-4b77-9330-600207288efd tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:48.946264 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1781c16e-3187-4b77-9330-600207288efd tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:49.085727 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-1781c16e-3187-4b77-9330-600207288efd tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c8c7437dd9443d8ddf4d10d8da6758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c189090d654b46c880b0d40f1e46a563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:49.093453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-1781c16e-3187-4b77-9330-600207288efd tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 200 len: 1513 microversion: 2.1 time: 0.164756 Oct 20 13:39:49.094020 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 302/566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:48 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:49.113117 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-0a7afa39-5150-43bd-98b8-3ea56a30f203 req-581e3b4e-32a1-4c4e-be47-5079576ea02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370db21c-b140-47ce-b86d-73159b9151c0", "name": "network-vif-deleted", "tag": "33ea7c12-93c6-4153-99db-81b8ff7a47c7"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:49.124404 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-0a7afa39-5150-43bd-98b8-3ea56a30f203 req-581e3b4e-32a1-4c4e-be47-5079576ea02c service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:49.124891 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-0a7afa39-5150-43bd-98b8-3ea56a30f203 req-581e3b4e-32a1-4c4e-be47-5079576ea02c service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:49.125341 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-0a7afa39-5150-43bd-98b8-3ea56a30f203 req-581e3b4e-32a1-4c4e-be47-5079576ea02c service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:49.138278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-0a7afa39-5150-43bd-98b8-3ea56a30f203 req-581e3b4e-32a1-4c4e-be47-5079576ea02c service nova] Creating event network-vif-deleted:33ea7c12-93c6-4153-99db-81b8ff7a47c7 for instance 370db21c-b140-47ce-b86d-73159b9151c0 on hv-cinder-86213 Oct 20 13:39:49.143796 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-0a7afa39-5150-43bd-98b8-3ea56a30f203 req-581e3b4e-32a1-4c4e-be47-5079576ea02c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034363 Oct 20 13:39:49.144764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 265/567] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:50.116498 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:50.117140 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] [instance: 370db21c-b140-47ce-b86d-73159b9151c0] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:50.123750 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:50.124247 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:50.124651 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:50.125356 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:50.125802 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:50.126217 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:50.141414 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] HTTP exception thrown: Instance 370db21c-b140-47ce-b86d-73159b9151c0 could not be found. Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Request method failure captured: Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 HTTP/1.1 Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 0 Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU8pTRsAh6F7Z5j7YMIKToQNTgPP4pQPV43nnN04M_JJBvHLugvPDaLmhcLON4SqK6zrDonPWrWJXV8hzuLGNmb_c7wBv29MERlKJOI3SZoTEqnsyeDxL_2u5s79TWk12SHFL_w4O8Jw2xrqoAdysJP6NuS-443k6gvdyEc6mDMIhjM Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: c189090d654b46c880b0d40f1e46a563 Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2039420125 Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:39:50.143692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c189090d654b46c880b0d40f1e46a563"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c189090d654b46c880b0d40f1e46a563"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c189090d654b46c880b0d40f1e46a563"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c189090d654b46c880b0d40f1e46a563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-VolumesSnapshotTestJSON-2039420125 Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: c189090d654b46c880b0d40f1e46a563 Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2039420125 Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-VolumesSnapshotTestJSON-2039420125-project Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 41c8c7437dd9443d8ddf4d10d8da6758 Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-VolumesSnapshotTestJSON-2039420125-project Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: > Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Instance 370db21c-b140-47ce-b86d-73159b9151c0 could not be found. Oct 20 13:39:50.145274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'id': '370db21c-b140-47ce-b86d-73159b9151c0'} Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 370db21c-b140-47ce-b86d-73159b9151c0 could not be found. Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:39:50.146068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370db21c-b140-47ce-b86d-73159b9151c0 could not be found. Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370db21c-b140-47ce-b86d-73159b9151c0 could not be found. Oct 20 13:39:50.147232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:39:50.148320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] Returning 404 to user: Instance 370db21c-b140-47ce-b86d-73159b9151c0 could not be found. {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:39:50.148320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-630435aa-9c2b-4f6f-9278-b14a8993dec3 tempest-VolumesSnapshotTestJSON-2039420125 tempest-VolumesSnapshotTestJSON-2039420125-project] 10.222.0.23 "GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0" status: 404 len: 111 microversion: 2.1 time: 0.032413 Oct 20 13:39:50.148320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 303/568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:50 2022] GET /compute/v2.1/servers/370db21c-b140-47ce-b86d-73159b9151c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:39:52.011527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a525fdb0-a9ee-4a67-8de5-ec6954055900 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:52.012090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a525fdb0-a9ee-4a67-8de5-ec6954055900 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:52.018718 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a525fdb0-a9ee-4a67-8de5-ec6954055900 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:52.019196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a525fdb0-a9ee-4a67-8de5-ec6954055900 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:52.019631 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a525fdb0-a9ee-4a67-8de5-ec6954055900 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:52.020313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a525fdb0-a9ee-4a67-8de5-ec6954055900 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:52.020764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a525fdb0-a9ee-4a67-8de5-ec6954055900 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:52.021229 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a525fdb0-a9ee-4a67-8de5-ec6954055900 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:52.049917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a525fdb0-a9ee-4a67-8de5-ec6954055900 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments/6148b8e8-406a-40e9-b8f0-8355aa31b06f" status: 200 len: 194 microversion: 2.20 time: 0.044215 Oct 20 13:39:52.050563 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 266/569] 10.222.0.23 () {60 vars in 1454 bytes} [Thu Oct 20 13:39:52 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments/6148b8e8-406a-40e9-b8f0-8355aa31b06f => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:39:52.122762 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-aec527ed-c13d-42ea-b2f6-303db492d752 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:52.123529 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-aec527ed-c13d-42ea-b2f6-303db492d752 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:52.129853 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aec527ed-c13d-42ea-b2f6-303db492d752 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:52.130324 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aec527ed-c13d-42ea-b2f6-303db492d752 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:52.130777 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aec527ed-c13d-42ea-b2f6-303db492d752 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:52.131451 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aec527ed-c13d-42ea-b2f6-303db492d752 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:52.131898 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aec527ed-c13d-42ea-b2f6-303db492d752 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:52.132315 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aec527ed-c13d-42ea-b2f6-303db492d752 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:52.211309 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.objects.instance [None req-aec527ed-c13d-42ea-b2f6-303db492d752 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lazy-loading 'services' on Instance uuid 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 {{(pid=125447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:39:52.280214 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-aec527ed-c13d-42ea-b2f6-303db492d752 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments/6148b8e8-406a-40e9-b8f0-8355aa31b06f" status: 202 len: 0 microversion: 2.20 time: 0.161237 Oct 20 13:39:52.280798 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 304/570] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Oct 20 13:39:52 2022] DELETE /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments/6148b8e8-406a-40e9-b8f0-8355aa31b06f => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:39:52.289165 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d293eb03-af2e-41dd-9767-c7e7fdf9d976 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:52.291353 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d293eb03-af2e-41dd-9767-c7e7fdf9d976 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:52.297266 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d293eb03-af2e-41dd-9767-c7e7fdf9d976 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:52.297727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d293eb03-af2e-41dd-9767-c7e7fdf9d976 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:52.298152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d293eb03-af2e-41dd-9767-c7e7fdf9d976 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:52.299355 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d293eb03-af2e-41dd-9767-c7e7fdf9d976 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:52.299800 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d293eb03-af2e-41dd-9767-c7e7fdf9d976 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:52.300224 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d293eb03-af2e-41dd-9767-c7e7fdf9d976 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:52.318563 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:52.333292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d293eb03-af2e-41dd-9767-c7e7fdf9d976 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048067 Oct 20 13:39:52.333838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 267/571] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 20 13:39:52 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:39:53.347563 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-587fbdbf-79dd-49ab-96d1-fddc8988d759 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:53.349900 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-587fbdbf-79dd-49ab-96d1-fddc8988d759 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:53.356060 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-587fbdbf-79dd-49ab-96d1-fddc8988d759 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:53.356533 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-587fbdbf-79dd-49ab-96d1-fddc8988d759 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:53.356985 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-587fbdbf-79dd-49ab-96d1-fddc8988d759 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:53.357662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-587fbdbf-79dd-49ab-96d1-fddc8988d759 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:53.358107 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-587fbdbf-79dd-49ab-96d1-fddc8988d759 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:53.358520 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-587fbdbf-79dd-49ab-96d1-fddc8988d759 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:53.388142 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-587fbdbf-79dd-49ab-96d1-fddc8988d759 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046009 Oct 20 13:39:53.388685 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 305/572] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 20 13:39:53 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:39:54.400696 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-aace3737-afff-48bb-825e-37a81c56ab09 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:54.402769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-aace3737-afff-48bb-825e-37a81c56ab09 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:54.409673 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aace3737-afff-48bb-825e-37a81c56ab09 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:54.410154 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aace3737-afff-48bb-825e-37a81c56ab09 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:54.410587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aace3737-afff-48bb-825e-37a81c56ab09 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:54.411273 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aace3737-afff-48bb-825e-37a81c56ab09 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:54.411725 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aace3737-afff-48bb-825e-37a81c56ab09 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:54.412153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aace3737-afff-48bb-825e-37a81c56ab09 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:54.441587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-aace3737-afff-48bb-825e-37a81c56ab09 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044960 Oct 20 13:39:54.442142 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 268/573] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 20 13:39:54 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:39:55.454150 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-8afe2347-d122-46a0-83f9-0614dd77b411 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:55.457030 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-8afe2347-d122-46a0-83f9-0614dd77b411 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:55.459499 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:55.464718 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8afe2347-d122-46a0-83f9-0614dd77b411 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:55.465242 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8afe2347-d122-46a0-83f9-0614dd77b411 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:55.465678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8afe2347-d122-46a0-83f9-0614dd77b411 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:55.466370 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8afe2347-d122-46a0-83f9-0614dd77b411 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:55.466820 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8afe2347-d122-46a0-83f9-0614dd77b411 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:55.467242 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-8afe2347-d122-46a0-83f9-0614dd77b411 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:55.496596 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-8afe2347-d122-46a0-83f9-0614dd77b411 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046372 Oct 20 13:39:55.497195 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 306/574] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 20 13:39:55 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:55.563620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b1063c4e-f76e-47b2-b96a-e10110454306 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:55.564976 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b1063c4e-f76e-47b2-b96a-e10110454306 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:55.571991 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1063c4e-f76e-47b2-b96a-e10110454306 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:55.572409 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1063c4e-f76e-47b2-b96a-e10110454306 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:55.572835 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1063c4e-f76e-47b2-b96a-e10110454306 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:55.573541 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1063c4e-f76e-47b2-b96a-e10110454306 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:55.573989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1063c4e-f76e-47b2-b96a-e10110454306 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:55.574411 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1063c4e-f76e-47b2-b96a-e10110454306 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:55.600449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b1063c4e-f76e-47b2-b96a-e10110454306 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:39:55.674649 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b1063c4e-f76e-47b2-b96a-e10110454306 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 204 len: 0 microversion: 2.20 time: 0.114219 Oct 20 13:39:55.675614 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 269/575] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 20 13:39:55 2022] DELETE /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 20 13:39:55.684431 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:55.685082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:55.691338 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:55.691820 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:55.692261 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:55.692992 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:55.693452 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:55.693879 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:55.833035 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:55.841664 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:55.843441 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:55.844599 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-636be2be-3143-47cd-87ae-8fe05128dfdb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.164272 Oct 20 13:39:55.845197 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 307/576] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:39:55 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:39:56.874223 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:56.874915 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:56.882432 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:56.882907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:56.883332 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:56.884028 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:56.884467 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:56.884906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:57.016383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:57.024511 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:57.025981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:57.027115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-285c2391-245b-4bc2-9289-f0193c29ae20 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1722 microversion: 2.20 time: 0.157388 Oct 20 13:39:57.027684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 270/577] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:39:56 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:39:58.052393 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:58.053254 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:58.059595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:58.060071 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:58.060506 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:58.061222 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:58.061668 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:58.062085 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:58.125842 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:58.134104 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:58.135544 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:58.136682 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-494eb097-2476-498a-858b-de58aeb0f822 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1655 microversion: 2.20 time: 0.088245 Oct 20 13:39:58.137513 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 308/578] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:39:58 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:39:58.348022 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-15cab742-075b-4157-a07f-1a2d64527f65 req-451ee8c7-91ce-41a4-bd20-af7a8ad58099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b9ae5b-1e55-409f-9a61-b1e2a47d1b58", "name": "network-vif-deleted", "tag": "c4329cd6-ac99-4465-b271-c87f6eb593c4"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:39:58.358043 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-15cab742-075b-4157-a07f-1a2d64527f65 req-451ee8c7-91ce-41a4-bd20-af7a8ad58099 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:58.358521 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-15cab742-075b-4157-a07f-1a2d64527f65 req-451ee8c7-91ce-41a4-bd20-af7a8ad58099 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:58.358954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-15cab742-075b-4157-a07f-1a2d64527f65 req-451ee8c7-91ce-41a4-bd20-af7a8ad58099 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:58.371206 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-15cab742-075b-4157-a07f-1a2d64527f65 req-451ee8c7-91ce-41a4-bd20-af7a8ad58099 service nova] Creating event network-vif-deleted:c4329cd6-ac99-4465-b271-c87f6eb593c4 for instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 on hv-cinder-86213 Oct 20 13:39:58.377640 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-15cab742-075b-4157-a07f-1a2d64527f65 req-451ee8c7-91ce-41a4-bd20-af7a8ad58099 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032830 Oct 20 13:39:58.378481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 271/579] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:39:58.686532 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-1db8cde5-e210-457d-ab4b-296df8f83d97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:58.691397 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-1db8cde5-e210-457d-ab4b-296df8f83d97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:58.699606 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1db8cde5-e210-457d-ab4b-296df8f83d97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:58.700246 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1db8cde5-e210-457d-ab4b-296df8f83d97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:58.700675 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1db8cde5-e210-457d-ab4b-296df8f83d97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:58.701469 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1db8cde5-e210-457d-ab4b-296df8f83d97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:58.701919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1db8cde5-e210-457d-ab4b-296df8f83d97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:58.702332 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1db8cde5-e210-457d-ab4b-296df8f83d97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:58.742590 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-1db8cde5-e210-457d-ab4b-296df8f83d97 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060924 Oct 20 13:39:58.743807 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 309/580] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:39:58 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 13:39:58.849216 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9a994d85-b84d-4a0a-aaef-dc75e616b1d0 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:58.849798 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9a994d85-b84d-4a0a-aaef-dc75e616b1d0 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:58.856062 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a994d85-b84d-4a0a-aaef-dc75e616b1d0 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:58.856570 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a994d85-b84d-4a0a-aaef-dc75e616b1d0 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:58.857134 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a994d85-b84d-4a0a-aaef-dc75e616b1d0 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:58.857853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a994d85-b84d-4a0a-aaef-dc75e616b1d0 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:58.858349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a994d85-b84d-4a0a-aaef-dc75e616b1d0 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:58.858835 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a994d85-b84d-4a0a-aaef-dc75e616b1d0 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:58.885802 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9a994d85-b84d-4a0a-aaef-dc75e616b1d0 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:39:58.964124 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9a994d85-b84d-4a0a-aaef-dc75e616b1d0 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 204 len: 0 microversion: 2.1 time: 0.118737 Oct 20 13:39:58.964638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 272/581] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:39:58 2022] DELETE /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:39:58.973870 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-2fa1638f-aa49-4820-b431-0bd881cabac1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:58.974564 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-2fa1638f-aa49-4820-b431-0bd881cabac1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:58.980996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2fa1638f-aa49-4820-b431-0bd881cabac1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:58.981569 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2fa1638f-aa49-4820-b431-0bd881cabac1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:58.982097 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2fa1638f-aa49-4820-b431-0bd881cabac1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:58.982880 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2fa1638f-aa49-4820-b431-0bd881cabac1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:58.983404 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2fa1638f-aa49-4820-b431-0bd881cabac1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:58.983831 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-2fa1638f-aa49-4820-b431-0bd881cabac1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:59.126292 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-2fa1638f-aa49-4820-b431-0bd881cabac1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:59.134792 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-2fa1638f-aa49-4820-b431-0bd881cabac1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1672 microversion: 2.1 time: 0.165762 Oct 20 13:39:59.135359 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 310/582] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:39:58 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:39:59.163546 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:39:59.164287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:39:59.170143 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:59.170615 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:59.171041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:59.171716 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:59.172158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:59.172569 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:59.205222 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:39:59.205701 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:39:59.206123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:39:59.206557 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lazy-loading 'fault' on Instance uuid 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:39:59.249676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:59.258450 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:59.259891 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:39:59.261066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-13cb5e30-de88-44f5-9c5b-4a276175f5e1 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1371 microversion: 2.20 time: 0.101726 Oct 20 13:39:59.261624 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 273/583] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:39:59 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:00.157445 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-15ab56a1-d27a-4402-a91b-2511158759da tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:00.158041 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-15ab56a1-d27a-4402-a91b-2511158759da tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:00.164373 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15ab56a1-d27a-4402-a91b-2511158759da tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:00.164849 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15ab56a1-d27a-4402-a91b-2511158759da tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:00.165309 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15ab56a1-d27a-4402-a91b-2511158759da tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:00.165986 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15ab56a1-d27a-4402-a91b-2511158759da tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:00.166434 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15ab56a1-d27a-4402-a91b-2511158759da tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:00.166852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15ab56a1-d27a-4402-a91b-2511158759da tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:00.286213 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:00.286830 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:00.293202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:00.293689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:00.294125 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:00.294814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:00.295267 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:00.295687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:00.300277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-15ab56a1-d27a-4402-a91b-2511158759da tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:00.307839 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-15ab56a1-d27a-4402-a91b-2511158759da tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1672 microversion: 2.1 time: 0.154334 Oct 20 13:40:00.308405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 311/584] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:00 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:00.327422 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:00.327900 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:00.328337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:00.328783 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lazy-loading 'fault' on Instance uuid 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:40:00.367744 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:00.375920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:00.378047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:00.379182 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2f41ec49-be6b-4c59-8fe8-7b793babdf57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1371 microversion: 2.20 time: 0.096949 Oct 20 13:40:00.379740 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 274/585] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:00 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:40:01.138793 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-929e7c8e-e6f2-46a5-a218-8ab82f155a8b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0bf67ff-710d-4558-8467-6a869ea6d959"}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:01.141102 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-929e7c8e-e6f2-46a5-a218-8ab82f155a8b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:01.147612 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-929e7c8e-e6f2-46a5-a218-8ab82f155a8b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:01.148098 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-929e7c8e-e6f2-46a5-a218-8ab82f155a8b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:01.148535 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-929e7c8e-e6f2-46a5-a218-8ab82f155a8b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:01.149264 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-929e7c8e-e6f2-46a5-a218-8ab82f155a8b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:01.149723 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-929e7c8e-e6f2-46a5-a218-8ab82f155a8b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:01.150152 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-929e7c8e-e6f2-46a5-a218-8ab82f155a8b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:01.331354 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-36dbe7cc-708d-42ee-b9ff-67685e10d0b5 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:01.331981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-36dbe7cc-708d-42ee-b9ff-67685e10d0b5 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:01.338315 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36dbe7cc-708d-42ee-b9ff-67685e10d0b5 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:01.338789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36dbe7cc-708d-42ee-b9ff-67685e10d0b5 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:01.339215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36dbe7cc-708d-42ee-b9ff-67685e10d0b5 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:01.340015 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36dbe7cc-708d-42ee-b9ff-67685e10d0b5 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:01.340472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36dbe7cc-708d-42ee-b9ff-67685e10d0b5 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:01.340924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-36dbe7cc-708d-42ee-b9ff-67685e10d0b5 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:01.470144 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-36dbe7cc-708d-42ee-b9ff-67685e10d0b5 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:01.477711 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-36dbe7cc-708d-42ee-b9ff-67685e10d0b5 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1672 microversion: 2.1 time: 0.150661 Oct 20 13:40:01.478272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 275/586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:01 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:01.482573 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:01.483168 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:01.488701 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:01.489210 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:01.489645 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:01.490322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:01.490774 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:01.491191 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:01.524779 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:01.525290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:01.525722 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:01.526166 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lazy-loading 'fault' on Instance uuid 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:40:01.565287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:01.573171 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:01.574605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:01.575738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fc972dc9-0262-4e7d-adac-cb3eaa777019 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1371 microversion: 2.20 time: 0.096567 Oct 20 13:40:01.576300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 276/587] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:01 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:02.502816 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a4bcffef-9a6b-425d-9d32-1501e40f02fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:02.503438 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a4bcffef-9a6b-425d-9d32-1501e40f02fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:02.509897 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a4bcffef-9a6b-425d-9d32-1501e40f02fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:02.510748 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a4bcffef-9a6b-425d-9d32-1501e40f02fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:02.510851 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a4bcffef-9a6b-425d-9d32-1501e40f02fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:02.511447 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a4bcffef-9a6b-425d-9d32-1501e40f02fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:02.511887 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a4bcffef-9a6b-425d-9d32-1501e40f02fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:02.512300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a4bcffef-9a6b-425d-9d32-1501e40f02fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:02.638727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a4bcffef-9a6b-425d-9d32-1501e40f02fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:02.646800 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a4bcffef-9a6b-425d-9d32-1501e40f02fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1672 microversion: 2.1 time: 0.147992 Oct 20 13:40:02.647354 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 277/588] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:02 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:02.651629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:02.652219 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:02.658054 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:02.658545 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:02.658988 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:02.659655 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:02.660097 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:02.660506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:02.689338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:02.689806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:02.690228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:02.690670 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lazy-loading 'fault' on Instance uuid 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:40:02.732736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:02.740564 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:02.742023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:02.743140 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-38ee4dd4-9564-4cd0-bab5-b47f210d86fe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1371 microversion: 2.20 time: 0.094897 Oct 20 13:40:02.743695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 278/589] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:02 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:03.670854 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-431d820a-6732-4f76-aa83-340f60594546 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:03.671543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-431d820a-6732-4f76-aa83-340f60594546 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:03.679681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-431d820a-6732-4f76-aa83-340f60594546 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:03.680197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-431d820a-6732-4f76-aa83-340f60594546 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:03.680818 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-431d820a-6732-4f76-aa83-340f60594546 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:03.681534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-431d820a-6732-4f76-aa83-340f60594546 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:03.682056 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-431d820a-6732-4f76-aa83-340f60594546 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:03.682476 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-431d820a-6732-4f76-aa83-340f60594546 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:03.816679 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-431d820a-6732-4f76-aa83-340f60594546 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:03.825564 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-431d820a-6732-4f76-aa83-340f60594546 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1672 microversion: 2.1 time: 0.158630 Oct 20 13:40:03.841047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 279/590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:03 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:03.848021 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:03.848635 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:03.850247 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:03.854601 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:03.855358 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:03.855939 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:03.856798 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:03.857278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:03.857706 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:03.862991 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:03.898391 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:03.898865 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:03.899294 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:03.899741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lazy-loading 'fault' on Instance uuid 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:40:03.944162 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:03.952099 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:03.953589 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:03.954825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-314a052b-59d3-4ccd-93f0-6777f3638707 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 200 len: 1371 microversion: 2.20 time: 0.112751 Oct 20 13:40:03.955642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 280/591] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:03 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:03.981541 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-929e7c8e-e6f2-46a5-a218-8ab82f155a8b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.846632 Oct 20 13:40:03.982136 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 312/592] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:40:01 2022] POST /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments => generated 194 bytes in 2848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:04.851563 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-67494c78-d2cb-4088-907b-ef7fb493ce32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:04.852176 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-67494c78-d2cb-4088-907b-ef7fb493ce32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:04.858542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67494c78-d2cb-4088-907b-ef7fb493ce32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:04.859029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67494c78-d2cb-4088-907b-ef7fb493ce32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:04.859463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67494c78-d2cb-4088-907b-ef7fb493ce32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:04.860153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67494c78-d2cb-4088-907b-ef7fb493ce32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:04.861183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67494c78-d2cb-4088-907b-ef7fb493ce32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:04.861848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67494c78-d2cb-4088-907b-ef7fb493ce32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:04.954586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-67494c78-d2cb-4088-907b-ef7fb493ce32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:04.962284 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-67494c78-d2cb-4088-907b-ef7fb493ce32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 200 len: 1604 microversion: 2.1 time: 0.114632 Oct 20 13:40:04.962876 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 281/593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:04 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 1604 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:04.983603 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:04.984306 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:04.991092 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:04.991579 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:04.992016 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:04.992746 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:04.993223 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:04.993646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:05.007923 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] HTTP exception thrown: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Request method failure captured: Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 HTTP/1.1 Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 0 Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6yUtEnt2EtPF7G1mURPCnzR_5_e5eJ-J2u3s3iMnmuMh3NQnc7cLPiUlcQiomZhWnF6wUInAYBkYEDpSkwWcjlck_m6LADHNrTNRcuev5ztbzIzwhAv59BAquofQ96WzAp7T6sW17gb0Vtbqvan27ep67VGFXveP7w9n7BmWHCUdU Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:40:05.009617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9addc326c51410f809805d8b44c5c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 55526ddbea014e6cbf7c079cb204059e Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: > Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:40:05.011090 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'id': '93b9ae5b-1e55-409f-9a61-b1e2a47d1b58'} Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:40:05.011833 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:40:05.013646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:40:05.015638 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Returning 404 to user: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:40:05.015638 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-6ea579ba-0a79-408d-89f0-8bd112c51473 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 404 len: 111 microversion: 2.20 time: 0.032269 Oct 20 13:40:05.015638 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 313/594] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:04 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 13:40:05.020913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-02cc7be1-8ef8-4858-8580-c7cd699e9f6f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '.version_select at 0x7ffa12cea700>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:05.043287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-02cc7be1-8ef8-4858-8580-c7cd699e9f6f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-799321792" status: 204 len: 0 microversion: 2.20 time: 0.027117 Oct 20 13:40:05.044196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 282/595] 10.222.0.23 () {60 vars in 1259 bytes} [Thu Oct 20 13:40:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-799321792 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 20 13:40:05.071003 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-952a00c9-558b-44cb-a49b-7c29690dba26 req-63b6256b-1598-42f0-ad28-cd6985c171f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19146772-f7e2-43d8-b7b3-3c365f024e54", "name": "network-vif-deleted", "tag": "20c71ca9-62f4-4658-828a-7e49ec9d9631"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:05.080764 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-952a00c9-558b-44cb-a49b-7c29690dba26 req-63b6256b-1598-42f0-ad28-cd6985c171f4 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:05.081267 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-952a00c9-558b-44cb-a49b-7c29690dba26 req-63b6256b-1598-42f0-ad28-cd6985c171f4 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:05.081693 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-952a00c9-558b-44cb-a49b-7c29690dba26 req-63b6256b-1598-42f0-ad28-cd6985c171f4 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:05.107775 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-952a00c9-558b-44cb-a49b-7c29690dba26 req-63b6256b-1598-42f0-ad28-cd6985c171f4 service nova] Creating event network-vif-deleted:20c71ca9-62f4-4658-828a-7e49ec9d9631 for instance 19146772-f7e2-43d8-b7b3-3c365f024e54 on hv-cinder-86213 Oct 20 13:40:05.126948 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-952a00c9-558b-44cb-a49b-7c29690dba26 req-63b6256b-1598-42f0-ad28-cd6985c171f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049676 Oct 20 13:40:05.126948 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 314/596] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:05.989655 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:05.990830 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:05.998183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:05.999048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:05.999671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:06.000380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:06.002159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:06.002159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:06.018002 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] HTTP exception thrown: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Request method failure captured: Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 HTTP/1.1 Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6uZk5u9C94mQ-NIaXkVtsejJkSwYuh99OauH6-ODZjT3DJORjrbsPQkdSdiC6tHvpHKpDL4mscQSlAQCTNPC5L_GK24Qun-9YS-7QorGoifSoDwT9-clJFUI6V9D7Yf4wTrD4EcgwYqP2AfZPhm5rWQvWWr64qHW21ZgnkjfaluuE Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:40:06.019681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: fe56d1d4278c43cd96a39f7f75f373b8 Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:40:06.021283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '19146772-f7e2-43d8-b7b3-3c365f024e54'} Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:40:06.022202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:40:06.023586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:06.024644 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Returning 404 to user: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:40:06.024644 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e43319b5-ad11-4795-8ecf-65c93572ab6e tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 404 len: 111 microversion: 2.1 time: 0.036541 Oct 20 13:40:06.024780 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-00df02d0-0dd1-4695-81b9-2d2f95c71e9d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Action: 'create', calling method: .version_select at 0x7ffa12ce0670>, body: {"keypair": {"name": "tempest-keypair-38668589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3kOZw6b5cxy266QjIuMYBPf5I2eswLoZJyxqIgLok4M5oRfuQjh6o+5e5xy9gbNiDV43UUf11lIPQ/4WyiSePjkiovOg6q4ls9CGZGOaLFt7Qy6DUXJkOWBrff1SOnSA=="}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:06.025286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 283/597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:05 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:40:06.031530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4b8f0315-1880-465e-92a8-0932b246d73d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '.version_select at 0x7ffa12cea0d0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:06.039220 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:06.040184 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-00df02d0-0dd1-4695-81b9-2d2f95c71e9d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Getting quotas for project f9addc326c51410f809805d8b44c5c17. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:40:06.044949 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-00df02d0-0dd1-4695-81b9-2d2f95c71e9d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Getting quotas for user 55526ddbea014e6cbf7c079cb204059e and project f9addc326c51410f809805d8b44c5c17. Resources: {'key_pairs'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:40:06.057312 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4b8f0315-1880-465e-92a8-0932b246d73d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-919390858" status: 202 len: 0 microversion: 2.1 time: 0.029489 Oct 20 13:40:06.058235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 284/598] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 20 13:40:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-919390858 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:40:06.071689 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-00df02d0-0dd1-4695-81b9-2d2f95c71e9d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.054964 Oct 20 13:40:06.072475 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 315/599] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 20 13:40:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 20 13:40:06.773438 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-af38b0c4-2870-4a79-8282-1e3d01863b22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'create', calling method: .version_select at 0x7ffa12d4b280>, body: {"keypair": {"name": "tempest-keypair-679910223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGE9C1XXL1oUebBpaC5Hz0dc4mqDG+2WbqbwJeCttsEtakqbdpg1uHGBj/8dnLveC88eeN2RKwmsua8yHWP1wSvRY9BD/dOVkh5hvbfQuhXu3XGjVXNBVsy8Ee6JU+NPw=="}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:06.792410 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-af38b0c4-2870-4a79-8282-1e3d01863b22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Getting quotas for project 747a468811fb478aa6c49b848ccee6d0. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:40:06.796617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-af38b0c4-2870-4a79-8282-1e3d01863b22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Getting quotas for user fe56d1d4278c43cd96a39f7f75f373b8 and project 747a468811fb478aa6c49b848ccee6d0. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:40:06.818627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-af38b0c4-2870-4a79-8282-1e3d01863b22 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049260 Oct 20 13:40:06.819226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 285/600] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 20 13:40:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:07.595798 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1271347122", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c859482-bc24-4f85-8ad7-70cfdb97a23e"}], "security_groups": [{"name": "tempest-securitygroup--1076453800"}], "key_name": "tempest-keypair-38668589", "user_data": "}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:07.730029 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.network.neutron [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] validate_networks() for [('9c859482-bc24-4f85-8ad7-70cfdb97a23e', None, None, None, None, None)] {{(pid=125447) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:40:08.363062 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Flavor limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:40:08.363609 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Image limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:40:08.364142 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Flavor pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:40:08.364489 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Image pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:40:08.364921 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:40:08.374284 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:08.374763 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:08.375201 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:08.376414 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:08.377169 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:08.377529 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:08.394635 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Getting quotas for project f9addc326c51410f809805d8b44c5c17. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:40:08.398885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Getting quotas for user 55526ddbea014e6cbf7c079cb204059e and project f9addc326c51410f809805d8b44c5c17. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:40:08.410916 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Going to run 1 instances... {{(pid=125447) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:40:08.413352 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125447) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:40:08.459840 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-dc79f3a6-353a-4671-9340-0894b55c4f21 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.869850 Oct 20 13:40:08.460674 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 316/601] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 20 13:40:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 20 13:40:08.473392 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0ad81e7f-19a4-4bd6-add6-931ab7eb7e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:08.474222 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0ad81e7f-19a4-4bd6-add6-931ab7eb7e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:08.555962 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0ad81e7f-19a4-4bd6-add6-931ab7eb7e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:08.564185 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0ad81e7f-19a4-4bd6-add6-931ab7eb7e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:08.566036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0ad81e7f-19a4-4bd6-add6-931ab7eb7e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:08.567153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0ad81e7f-19a4-4bd6-add6-931ab7eb7e9a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1280 microversion: 2.20 time: 0.099472 Oct 20 13:40:08.568081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 286/602] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:08 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:08.816107 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-718688731", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d308b555-e032-40ef-ae84-228dba4540e0"}], "security_groups": [{"name": "tempest-securitygroup--404205083"}], "key_name": "tempest-keypair-679910223", "user_data": "}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:08.940017 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.network.neutron [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] validate_networks() for [('d308b555-e032-40ef-ae84-228dba4540e0', None, None, None, None, None)] {{(pid=125447) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:40:09.337340 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Flavor limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:40:09.337763 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Image limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:40:09.338271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Flavor pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:40:09.338647 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Image pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:40:09.339056 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:40:09.348600 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:09.349114 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:09.349544 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:09.350256 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:09.350703 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:09.351123 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:09.367815 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Getting quotas for project 747a468811fb478aa6c49b848ccee6d0. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:40:09.371722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Getting quotas for user fe56d1d4278c43cd96a39f7f75f373b8 and project 747a468811fb478aa6c49b848ccee6d0. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:40:09.383957 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Going to run 1 instances... {{(pid=125447) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:40:09.386223 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125447) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:40:09.432207 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b29e5034-4365-42b7-811b-bf4a38ab8a30 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.621197 Oct 20 13:40:09.433053 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 317/603] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:40:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 13:40:09.444042 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0874de97-6f11-452f-8859-0b7a0464c189 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:09.444662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0874de97-6f11-452f-8859-0b7a0464c189 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:09.499139 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0874de97-6f11-452f-8859-0b7a0464c189 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:09.508637 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0874de97-6f11-452f-8859-0b7a0464c189 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1236 microversion: 2.1 time: 0.068283 Oct 20 13:40:09.509246 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 287/604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:09 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:09.591588 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:09.592193 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:09.599478 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:09.599962 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:09.600394 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:09.601117 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:09.601632 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:09.602056 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:09.665278 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:09.674660 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:09.675660 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:09.676619 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9bf7731c-d4c8-454e-b95d-1db00ef6d774 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1332 microversion: 2.20 time: 0.089171 Oct 20 13:40:09.677190 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 318/605] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:09 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:10.536154 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-06b6dd8d-a7dd-4be5-b871-0132d35739d2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:10.536881 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-06b6dd8d-a7dd-4be5-b871-0132d35739d2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:10.544504 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06b6dd8d-a7dd-4be5-b871-0132d35739d2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:10.545943 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06b6dd8d-a7dd-4be5-b871-0132d35739d2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:10.546836 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06b6dd8d-a7dd-4be5-b871-0132d35739d2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:10.549182 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06b6dd8d-a7dd-4be5-b871-0132d35739d2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:10.549866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06b6dd8d-a7dd-4be5-b871-0132d35739d2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:10.550528 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-06b6dd8d-a7dd-4be5-b871-0132d35739d2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:10.656490 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-06b6dd8d-a7dd-4be5-b871-0132d35739d2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:10.666671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-06b6dd8d-a7dd-4be5-b871-0132d35739d2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1232 microversion: 2.1 time: 0.137871 Oct 20 13:40:10.668449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 288/606] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:10 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1232 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:10.701646 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:10.702272 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:10.712430 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:10.712909 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:10.713367 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:10.714067 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:10.714551 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:10.714969 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:10.790262 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:10.799975 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:10.801677 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:10.802806 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-94887534-7b87-4982-9365-0b94b70afa2c tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1338 microversion: 2.20 time: 0.105017 Oct 20 13:40:10.803540 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 319/607] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:10 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:11.616453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a8b9ebb0-2463-4549-9620-bdc22069306f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:11.618835 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a8b9ebb0-2463-4549-9620-bdc22069306f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:11.625645 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8b9ebb0-2463-4549-9620-bdc22069306f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:11.626203 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8b9ebb0-2463-4549-9620-bdc22069306f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:11.626650 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8b9ebb0-2463-4549-9620-bdc22069306f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:11.627397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8b9ebb0-2463-4549-9620-bdc22069306f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:11.627795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8b9ebb0-2463-4549-9620-bdc22069306f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:11.628219 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8b9ebb0-2463-4549-9620-bdc22069306f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:11.651925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-a8b9ebb0-2463-4549-9620-bdc22069306f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lazy-loading 'flavor' on Instance uuid 5f326ad5-ca2f-4300-8676-2b6d7edfb108 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:40:11.691103 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-020930c9-a2e7-465b-a98f-12e54ea3e663 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:11.691715 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-020930c9-a2e7-465b-a98f-12e54ea3e663 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:11.698086 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-020930c9-a2e7-465b-a98f-12e54ea3e663 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:11.698618 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-020930c9-a2e7-465b-a98f-12e54ea3e663 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:11.699091 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-020930c9-a2e7-465b-a98f-12e54ea3e663 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:11.699854 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-020930c9-a2e7-465b-a98f-12e54ea3e663 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:11.700246 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-020930c9-a2e7-465b-a98f-12e54ea3e663 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:11.700846 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-020930c9-a2e7-465b-a98f-12e54ea3e663 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:11.778142 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-020930c9-a2e7-465b-a98f-12e54ea3e663 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:11.787786 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-020930c9-a2e7-465b-a98f-12e54ea3e663 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1294 microversion: 2.1 time: 0.101089 Oct 20 13:40:11.788353 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 320/608] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:11 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:11.814467 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a8b9ebb0-2463-4549-9620-bdc22069306f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/action" status: 200 len: 32 microversion: 2.1 time: 0.201551 Oct 20 13:40:11.815090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 289/609] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:40:11 2022] POST /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 13:40:11.824894 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0f58fb44-fcac-49b8-b664-ba0b01cbbbec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:11.825496 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0f58fb44-fcac-49b8-b664-ba0b01cbbbec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:11.834813 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:11.835549 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:11.841496 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f58fb44-fcac-49b8-b664-ba0b01cbbbec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:11.842658 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f58fb44-fcac-49b8-b664-ba0b01cbbbec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:11.843315 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f58fb44-fcac-49b8-b664-ba0b01cbbbec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:11.843974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:11.845105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:11.845850 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f58fb44-fcac-49b8-b664-ba0b01cbbbec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:11.846241 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f58fb44-fcac-49b8-b664-ba0b01cbbbec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:11.846688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:11.847019 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f58fb44-fcac-49b8-b664-ba0b01cbbbec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:11.847738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:11.848193 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:11.848801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:11.983585 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0f58fb44-fcac-49b8-b664-ba0b01cbbbec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:11.992733 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0f58fb44-fcac-49b8-b664-ba0b01cbbbec tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.171682 Oct 20 13:40:11.993758 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 321/610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:11 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:12.291908 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:12.300783 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:12.302346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:12.303681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9a925ca6-5444-47ab-b5a6-dbfa903dda8b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1406 microversion: 2.20 time: 0.473072 Oct 20 13:40:12.304321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 290/611] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:11 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1406 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:12.811250 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-40ef95a4-8ec2-40ef-b962-aa04bcd862ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:12.811872 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-40ef95a4-8ec2-40ef-b962-aa04bcd862ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:12.819622 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-40ef95a4-8ec2-40ef-b962-aa04bcd862ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:12.820110 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-40ef95a4-8ec2-40ef-b962-aa04bcd862ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:12.820660 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-40ef95a4-8ec2-40ef-b962-aa04bcd862ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:12.821571 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-40ef95a4-8ec2-40ef-b962-aa04bcd862ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:12.822026 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-40ef95a4-8ec2-40ef-b962-aa04bcd862ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:12.822441 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-40ef95a4-8ec2-40ef-b962-aa04bcd862ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:12.903780 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-40ef95a4-8ec2-40ef-b962-aa04bcd862ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:12.913132 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-40ef95a4-8ec2-40ef-b962-aa04bcd862ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1294 microversion: 2.1 time: 0.106118 Oct 20 13:40:12.913872 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 322/612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:12 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:13.017633 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cc7df6a8-e804-4b49-ac74-8675a7c84914 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:13.018155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cc7df6a8-e804-4b49-ac74-8675a7c84914 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:13.025740 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc7df6a8-e804-4b49-ac74-8675a7c84914 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:13.026232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc7df6a8-e804-4b49-ac74-8675a7c84914 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:13.026670 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc7df6a8-e804-4b49-ac74-8675a7c84914 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:13.027366 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc7df6a8-e804-4b49-ac74-8675a7c84914 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:13.028002 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc7df6a8-e804-4b49-ac74-8675a7c84914 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:13.028589 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc7df6a8-e804-4b49-ac74-8675a7c84914 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:13.114433 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-65868d2a-406f-4be6-892c-5cf50b92deaa req-04e17f1b-c7af-4e29-a5a2-d804899e4caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34aa5d9-ed42-4cdd-bed0-229455d27cf1", "tag": "220d420d-8061-47e0-9323-3ec3344c20c6"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:13.125467 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-65868d2a-406f-4be6-892c-5cf50b92deaa req-04e17f1b-c7af-4e29-a5a2-d804899e4caa service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:13.126509 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-65868d2a-406f-4be6-892c-5cf50b92deaa req-04e17f1b-c7af-4e29-a5a2-d804899e4caa service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:13.126939 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-65868d2a-406f-4be6-892c-5cf50b92deaa req-04e17f1b-c7af-4e29-a5a2-d804899e4caa service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:13.151240 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-65868d2a-406f-4be6-892c-5cf50b92deaa req-04e17f1b-c7af-4e29-a5a2-d804899e4caa service nova] Creating event network-changed:220d420d-8061-47e0-9323-3ec3344c20c6 for instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 on hv-cinder-86213 Oct 20 13:40:13.159301 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-65868d2a-406f-4be6-892c-5cf50b92deaa req-04e17f1b-c7af-4e29-a5a2-d804899e4caa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051017 Oct 20 13:40:13.160046 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 323/613] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:13.330654 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:13.331627 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:13.339520 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:13.340018 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:13.340452 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:13.341179 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:13.341631 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:13.342052 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:13.515202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cc7df6a8-e804-4b49-ac74-8675a7c84914 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:13.537995 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cc7df6a8-e804-4b49-ac74-8675a7c84914 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.524729 Oct 20 13:40:13.539403 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 291/614] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:13 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:13.571996 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:13.586514 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:13.590719 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:13.595360 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7250c68d-e286-4b18-a858-fd4477559471 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1406 microversion: 2.20 time: 0.267027 Oct 20 13:40:13.598644 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 324/615] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:13 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:40:13.936837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8459a365-19d4-4823-9d93-57aefad37c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:13.940786 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8459a365-19d4-4823-9d93-57aefad37c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:13.946424 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8459a365-19d4-4823-9d93-57aefad37c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:13.946910 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8459a365-19d4-4823-9d93-57aefad37c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:13.947500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8459a365-19d4-4823-9d93-57aefad37c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:13.948380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8459a365-19d4-4823-9d93-57aefad37c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:13.948833 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8459a365-19d4-4823-9d93-57aefad37c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:13.949285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8459a365-19d4-4823-9d93-57aefad37c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:14.155512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8459a365-19d4-4823-9d93-57aefad37c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:14.164655 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8459a365-19d4-4823-9d93-57aefad37c8c tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1361 microversion: 2.1 time: 0.231500 Oct 20 13:40:14.165392 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 292/616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:13 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:14.566000 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-31630898-6a22-479d-b374-e56dfad30a3d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:14.566684 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-31630898-6a22-479d-b374-e56dfad30a3d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:14.573224 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31630898-6a22-479d-b374-e56dfad30a3d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:14.573709 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31630898-6a22-479d-b374-e56dfad30a3d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:14.574139 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31630898-6a22-479d-b374-e56dfad30a3d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:14.574818 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31630898-6a22-479d-b374-e56dfad30a3d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:14.575267 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31630898-6a22-479d-b374-e56dfad30a3d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:14.575681 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31630898-6a22-479d-b374-e56dfad30a3d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:14.623956 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:14.624556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:14.631407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:14.631890 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:14.632318 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:14.633032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:14.633564 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:14.633881 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:14.764445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:14.773074 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:14.774523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:14.775637 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-02ecb470-db46-4b69-b03e-af3aa1a340cb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1406 microversion: 2.20 time: 0.155971 Oct 20 13:40:14.776201 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 293/617] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:14 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:40:14.793981 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-31630898-6a22-479d-b374-e56dfad30a3d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:14.803390 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-31630898-6a22-479d-b374-e56dfad30a3d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.242508 Oct 20 13:40:14.804064 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 325/618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:14 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:15.187202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b0e55378-2210-4b6f-9b2b-d755a4a439a7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:15.187899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b0e55378-2210-4b6f-9b2b-d755a4a439a7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:15.196058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b0e55378-2210-4b6f-9b2b-d755a4a439a7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:15.196545 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b0e55378-2210-4b6f-9b2b-d755a4a439a7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:15.197006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b0e55378-2210-4b6f-9b2b-d755a4a439a7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:15.197744 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b0e55378-2210-4b6f-9b2b-d755a4a439a7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:15.198201 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b0e55378-2210-4b6f-9b2b-d755a4a439a7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:15.198621 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b0e55378-2210-4b6f-9b2b-d755a4a439a7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:15.207654 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-d5c6cc09-b77e-4421-899d-05d0d008b614 req-4124855d-0708-4a5c-a275-9411a4203031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d730923-3277-4e78-9365-a95c403e26d8", "tag": "4c0b67a4-d502-4fe0-8fb2-21290e8ba8ea"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:15.218296 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-d5c6cc09-b77e-4421-899d-05d0d008b614 req-4124855d-0708-4a5c-a275-9411a4203031 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:15.219082 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-d5c6cc09-b77e-4421-899d-05d0d008b614 req-4124855d-0708-4a5c-a275-9411a4203031 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:15.219968 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-d5c6cc09-b77e-4421-899d-05d0d008b614 req-4124855d-0708-4a5c-a275-9411a4203031 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:15.232376 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-d5c6cc09-b77e-4421-899d-05d0d008b614 req-4124855d-0708-4a5c-a275-9411a4203031 service nova] Creating event network-changed:4c0b67a4-d502-4fe0-8fb2-21290e8ba8ea for instance 3d730923-3277-4e78-9365-a95c403e26d8 on hv-cinder-86213 Oct 20 13:40:15.238409 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-d5c6cc09-b77e-4421-899d-05d0d008b614 req-4124855d-0708-4a5c-a275-9411a4203031 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035500 Oct 20 13:40:15.239489 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 326/619] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:15.616602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b0e55378-2210-4b6f-9b2b-d755a4a439a7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:15.624324 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b0e55378-2210-4b6f-9b2b-d755a4a439a7 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1361 microversion: 2.1 time: 0.441050 Oct 20 13:40:15.624965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 294/620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:15 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1361 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:15.802895 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:15.803598 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:15.809972 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:15.810464 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:15.810899 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:15.811598 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:15.812051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:15.812474 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:15.827730 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2904c30d-e5db-4cb5-b6a2-94fbce0ba026 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:15.829666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2904c30d-e5db-4cb5-b6a2-94fbce0ba026 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:15.836339 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2904c30d-e5db-4cb5-b6a2-94fbce0ba026 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:15.836974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2904c30d-e5db-4cb5-b6a2-94fbce0ba026 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:15.837478 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2904c30d-e5db-4cb5-b6a2-94fbce0ba026 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:15.838234 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2904c30d-e5db-4cb5-b6a2-94fbce0ba026 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:15.838749 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2904c30d-e5db-4cb5-b6a2-94fbce0ba026 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:15.839231 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2904c30d-e5db-4cb5-b6a2-94fbce0ba026 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:15.946767 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:15.955611 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:15.957084 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:15.958187 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-30ac4fa1-a375-46bf-9918-14900b549aa4 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1406 microversion: 2.20 time: 0.160324 Oct 20 13:40:15.958750 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 327/621] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:15 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:16.239693 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2904c30d-e5db-4cb5-b6a2-94fbce0ba026 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:16.253534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2904c30d-e5db-4cb5-b6a2-94fbce0ba026 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.429559 Oct 20 13:40:16.254526 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 295/622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:15 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:16.647893 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5758ba22-0859-475d-a645-09a4a6e1be91 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:16.648502 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5758ba22-0859-475d-a645-09a4a6e1be91 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:16.654331 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5758ba22-0859-475d-a645-09a4a6e1be91 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:16.654814 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5758ba22-0859-475d-a645-09a4a6e1be91 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:16.655244 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5758ba22-0859-475d-a645-09a4a6e1be91 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:16.656140 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5758ba22-0859-475d-a645-09a4a6e1be91 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:16.656586 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5758ba22-0859-475d-a645-09a4a6e1be91 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:16.657128 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5758ba22-0859-475d-a645-09a4a6e1be91 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:16.982123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:16.982949 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:16.990512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:16.991206 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:16.991787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:16.992664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:16.993281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:16.994006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:17.118713 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5758ba22-0859-475d-a645-09a4a6e1be91 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:17.130266 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5758ba22-0859-475d-a645-09a4a6e1be91 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1361 microversion: 2.1 time: 0.485423 Oct 20 13:40:17.147138 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 328/623] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:16 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1361 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:17.224289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:17.233983 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:17.236105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:17.237500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-202d0552-48c7-4c87-a922-a1ed4e4a120b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1406 microversion: 2.20 time: 0.259187 Oct 20 13:40:17.240967 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 296/624] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:16 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:40:17.281042 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-aa1eb852-3100-4bbf-a4b3-d158e90cecd1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:17.282449 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-aa1eb852-3100-4bbf-a4b3-d158e90cecd1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:17.290206 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aa1eb852-3100-4bbf-a4b3-d158e90cecd1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:17.290739 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aa1eb852-3100-4bbf-a4b3-d158e90cecd1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:17.291204 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aa1eb852-3100-4bbf-a4b3-d158e90cecd1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:17.291981 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aa1eb852-3100-4bbf-a4b3-d158e90cecd1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:17.292505 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aa1eb852-3100-4bbf-a4b3-d158e90cecd1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:17.293078 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-aa1eb852-3100-4bbf-a4b3-d158e90cecd1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:17.621351 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-aa1eb852-3100-4bbf-a4b3-d158e90cecd1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:17.633223 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-aa1eb852-3100-4bbf-a4b3-d158e90cecd1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.358165 Oct 20 13:40:17.634427 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 329/625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:17 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:18.153831 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-23eeb9f1-1c93-4a45-968f-a41dd92b2615 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:18.154338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-23eeb9f1-1c93-4a45-968f-a41dd92b2615 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:18.162162 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-23eeb9f1-1c93-4a45-968f-a41dd92b2615 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:18.162905 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-23eeb9f1-1c93-4a45-968f-a41dd92b2615 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:18.163487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-23eeb9f1-1c93-4a45-968f-a41dd92b2615 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:18.164344 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-23eeb9f1-1c93-4a45-968f-a41dd92b2615 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:18.165043 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-23eeb9f1-1c93-4a45-968f-a41dd92b2615 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:18.165669 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-23eeb9f1-1c93-4a45-968f-a41dd92b2615 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:18.263670 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:18.264983 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:18.275311 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:18.276088 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:18.276768 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:18.279377 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:18.281424 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:18.285228 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:18.330449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-23eeb9f1-1c93-4a45-968f-a41dd92b2615 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:18.339082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-23eeb9f1-1c93-4a45-968f-a41dd92b2615 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1361 microversion: 2.1 time: 0.189080 Oct 20 13:40:18.343044 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 297/626] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:18 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:18.574716 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:18.589774 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:18.591354 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:18.592666 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b6396a74-7ecc-40da-8663-a6a1f5159c9f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1406 microversion: 2.20 time: 0.332755 Oct 20 13:40:18.593320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 330/627] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:18 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:40:18.658582 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0e9a7ae8-d9aa-4ddd-b3c9-c39d08ab4830 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:18.659562 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0e9a7ae8-d9aa-4ddd-b3c9-c39d08ab4830 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:18.665959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e9a7ae8-d9aa-4ddd-b3c9-c39d08ab4830 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:18.666451 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e9a7ae8-d9aa-4ddd-b3c9-c39d08ab4830 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:18.666883 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e9a7ae8-d9aa-4ddd-b3c9-c39d08ab4830 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:18.667605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e9a7ae8-d9aa-4ddd-b3c9-c39d08ab4830 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:18.668056 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e9a7ae8-d9aa-4ddd-b3c9-c39d08ab4830 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:18.668475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e9a7ae8-d9aa-4ddd-b3c9-c39d08ab4830 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:18.809354 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0e9a7ae8-d9aa-4ddd-b3c9-c39d08ab4830 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:18.819900 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0e9a7ae8-d9aa-4ddd-b3c9-c39d08ab4830 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.165551 Oct 20 13:40:18.820486 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 298/628] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:18 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:19.365071 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5fce3cea-42e7-45df-93d8-f7cb5db03d65 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:19.365742 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5fce3cea-42e7-45df-93d8-f7cb5db03d65 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:19.369900 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=4 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:19.375692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5fce3cea-42e7-45df-93d8-f7cb5db03d65 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:19.376415 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5fce3cea-42e7-45df-93d8-f7cb5db03d65 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:19.377036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5fce3cea-42e7-45df-93d8-f7cb5db03d65 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:19.378078 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5fce3cea-42e7-45df-93d8-f7cb5db03d65 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:19.378709 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5fce3cea-42e7-45df-93d8-f7cb5db03d65 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:19.379549 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5fce3cea-42e7-45df-93d8-f7cb5db03d65 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:19.381006 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=16 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:19.457494 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-d20221c0-6bee-4ad9-9e1c-b7e586a1308c req-dd86b964-996d-4b72-9b19-46149fde1315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34aa5d9-ed42-4cdd-bed0-229455d27cf1", "name": "network-vif-plugged", "status": "completed", "tag": "220d420d-8061-47e0-9323-3ec3344c20c6"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:19.474036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-d20221c0-6bee-4ad9-9e1c-b7e586a1308c req-dd86b964-996d-4b72-9b19-46149fde1315 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:19.475315 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-d20221c0-6bee-4ad9-9e1c-b7e586a1308c req-dd86b964-996d-4b72-9b19-46149fde1315 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:19.476429 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-d20221c0-6bee-4ad9-9e1c-b7e586a1308c req-dd86b964-996d-4b72-9b19-46149fde1315 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:19.502795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-d20221c0-6bee-4ad9-9e1c-b7e586a1308c req-dd86b964-996d-4b72-9b19-46149fde1315 service nova] Creating event network-vif-plugged:220d420d-8061-47e0-9323-3ec3344c20c6 for instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 on hv-cinder-86213 Oct 20 13:40:19.511851 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=8 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:19.520675 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-d20221c0-6bee-4ad9-9e1c-b7e586a1308c req-dd86b964-996d-4b72-9b19-46149fde1315 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079806 Oct 20 13:40:19.522173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 299/629] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:19.632626 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-5fce3cea-42e7-45df-93d8-f7cb5db03d65 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:19.641390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:19.644016 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5fce3cea-42e7-45df-93d8-f7cb5db03d65 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1361 microversion: 2.1 time: 0.283350 Oct 20 13:40:19.644175 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:19.644992 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 331/630] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:19 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:19.660052 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:19.660898 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:19.661741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:19.662979 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:19.663653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:19.664443 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:19.853591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-c45206bc-80c3-43f4-b5e8-1064a2cf7113 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:19.854224 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-c45206bc-80c3-43f4-b5e8-1064a2cf7113 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:19.862566 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c45206bc-80c3-43f4-b5e8-1064a2cf7113 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:19.863063 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c45206bc-80c3-43f4-b5e8-1064a2cf7113 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:19.864023 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c45206bc-80c3-43f4-b5e8-1064a2cf7113 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:19.865008 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c45206bc-80c3-43f4-b5e8-1064a2cf7113 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:19.865951 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c45206bc-80c3-43f4-b5e8-1064a2cf7113 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:19.866642 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-c45206bc-80c3-43f4-b5e8-1064a2cf7113 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:19.909264 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:19.913145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:19.920034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:19.922020 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:19.923769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-31df9929-ccd8-49d6-b6bc-100a62512856 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1406 microversion: 2.20 time: 0.307882 Oct 20 13:40:19.924909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 300/631] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:19 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:20.309751 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-c45206bc-80c3-43f4-b5e8-1064a2cf7113 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:20.318159 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-c45206bc-80c3-43f4-b5e8-1064a2cf7113 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.478117 Oct 20 13:40:20.318732 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 332/632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:19 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:20.668839 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b8fd4557-6da6-4b5b-bf6c-099bfff68a76 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:20.669507 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b8fd4557-6da6-4b5b-bf6c-099bfff68a76 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:20.678406 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b8fd4557-6da6-4b5b-bf6c-099bfff68a76 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:20.678900 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b8fd4557-6da6-4b5b-bf6c-099bfff68a76 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:20.679359 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b8fd4557-6da6-4b5b-bf6c-099bfff68a76 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:20.680243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b8fd4557-6da6-4b5b-bf6c-099bfff68a76 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:20.680700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b8fd4557-6da6-4b5b-bf6c-099bfff68a76 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:20.681174 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b8fd4557-6da6-4b5b-bf6c-099bfff68a76 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:20.831452 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b8fd4557-6da6-4b5b-bf6c-099bfff68a76 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:20.840208 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b8fd4557-6da6-4b5b-bf6c-099bfff68a76 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1361 microversion: 2.1 time: 0.176502 Oct 20 13:40:20.841142 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 301/633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:20 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:20.949486 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:20.950835 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:20.959073 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:20.959559 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:20.960160 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:20.961089 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:20.961692 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:20.962293 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:20.982483 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:21.216401 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:21.226835 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:21.228601 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:21.230096 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0e560151-37f4-4a6e-a7d7-788f69b6bb24 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1406 microversion: 2.20 time: 0.284519 Oct 20 13:40:21.230959 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 333/634] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:20 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:40:21.345129 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-be743ddb-417b-4ee4-ab6e-591569428159 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:21.346555 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-be743ddb-417b-4ee4-ab6e-591569428159 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:21.354651 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be743ddb-417b-4ee4-ab6e-591569428159 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:21.355737 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be743ddb-417b-4ee4-ab6e-591569428159 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:21.356380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be743ddb-417b-4ee4-ab6e-591569428159 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:21.357542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be743ddb-417b-4ee4-ab6e-591569428159 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:21.361628 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be743ddb-417b-4ee4-ab6e-591569428159 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:21.363088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be743ddb-417b-4ee4-ab6e-591569428159 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:21.543892 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-936862d0-1259-41ac-bb72-cc35d8d0fdd7 req-d250dd71-5a2f-4ba0-9362-465f20543410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d730923-3277-4e78-9365-a95c403e26d8", "name": "network-vif-plugged", "status": "completed", "tag": "4c0b67a4-d502-4fe0-8fb2-21290e8ba8ea"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:21.564058 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-936862d0-1259-41ac-bb72-cc35d8d0fdd7 req-d250dd71-5a2f-4ba0-9362-465f20543410 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:21.564909 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-936862d0-1259-41ac-bb72-cc35d8d0fdd7 req-d250dd71-5a2f-4ba0-9362-465f20543410 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:21.565578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-936862d0-1259-41ac-bb72-cc35d8d0fdd7 req-d250dd71-5a2f-4ba0-9362-465f20543410 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:21.580055 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-936862d0-1259-41ac-bb72-cc35d8d0fdd7 req-d250dd71-5a2f-4ba0-9362-465f20543410 service nova] Creating event network-vif-plugged:4c0b67a4-d502-4fe0-8fb2-21290e8ba8ea for instance 3d730923-3277-4e78-9365-a95c403e26d8 on hv-cinder-86213 Oct 20 13:40:21.586600 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-936862d0-1259-41ac-bb72-cc35d8d0fdd7 req-d250dd71-5a2f-4ba0-9362-465f20543410 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047451 Oct 20 13:40:21.587911 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 334/635] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:40:21.612113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-be743ddb-417b-4ee4-ab6e-591569428159 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:21.624672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-be743ddb-417b-4ee4-ab6e-591569428159 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.286729 Oct 20 13:40:21.637928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 302/636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:21 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:21.867316 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-22262eb9-b82b-44b2-853a-be661d184fb9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:21.871271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-22262eb9-b82b-44b2-853a-be661d184fb9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:21.878849 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:21.882886 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-22262eb9-b82b-44b2-853a-be661d184fb9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:21.883731 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-22262eb9-b82b-44b2-853a-be661d184fb9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:21.884349 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-22262eb9-b82b-44b2-853a-be661d184fb9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:21.885100 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-22262eb9-b82b-44b2-853a-be661d184fb9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:21.885848 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-22262eb9-b82b-44b2-853a-be661d184fb9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:21.886686 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-22262eb9-b82b-44b2-853a-be661d184fb9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:22.214678 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-22262eb9-b82b-44b2-853a-be661d184fb9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:22.224010 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-22262eb9-b82b-44b2-853a-be661d184fb9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1361 microversion: 2.1 time: 0.363516 Oct 20 13:40:22.237305 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 335/637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:21 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:22.259016 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:22.259633 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:22.267806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:22.267806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:22.268188 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:22.269085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:22.269689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:22.270264 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:22.419684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:22.429153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:22.431128 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:22.432471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9f94e1d2-7ee9-4e60-9b41-59296767408b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1597 microversion: 2.20 time: 0.178254 Oct 20 13:40:22.433728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 303/638] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:40:22 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1597 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:40:22.458600 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-1b8f69b7-d63b-42ad-84aa-641c7b1559ef tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:22.459340 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-1b8f69b7-d63b-42ad-84aa-641c7b1559ef tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:22.465970 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b8f69b7-d63b-42ad-84aa-641c7b1559ef tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:22.466458 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b8f69b7-d63b-42ad-84aa-641c7b1559ef tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:22.466890 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b8f69b7-d63b-42ad-84aa-641c7b1559ef tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:22.467591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b8f69b7-d63b-42ad-84aa-641c7b1559ef tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:22.468036 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b8f69b7-d63b-42ad-84aa-641c7b1559ef tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:22.468625 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b8f69b7-d63b-42ad-84aa-641c7b1559ef tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:22.580381 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-1b8f69b7-d63b-42ad-84aa-641c7b1559ef tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.125625 Oct 20 13:40:22.581212 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 336/639] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 20 13:40:22 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:40:22.652245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ec99ca3c-8c64-4841-af1f-ddf86b987126 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:22.653291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ec99ca3c-8c64-4841-af1f-ddf86b987126 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:22.659982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec99ca3c-8c64-4841-af1f-ddf86b987126 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:22.660737 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec99ca3c-8c64-4841-af1f-ddf86b987126 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:22.661200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec99ca3c-8c64-4841-af1f-ddf86b987126 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:22.662259 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec99ca3c-8c64-4841-af1f-ddf86b987126 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:22.662899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec99ca3c-8c64-4841-af1f-ddf86b987126 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:22.664947 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec99ca3c-8c64-4841-af1f-ddf86b987126 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:22.943036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ec99ca3c-8c64-4841-af1f-ddf86b987126 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:22.951882 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ec99ca3c-8c64-4841-af1f-ddf86b987126 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.305708 Oct 20 13:40:22.956627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 304/640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:22 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:23.248383 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3b537098-8905-44a9-8ef5-eac1242b5f32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:23.249022 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3b537098-8905-44a9-8ef5-eac1242b5f32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:23.264477 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b537098-8905-44a9-8ef5-eac1242b5f32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:23.265278 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b537098-8905-44a9-8ef5-eac1242b5f32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:23.266584 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b537098-8905-44a9-8ef5-eac1242b5f32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:23.267791 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b537098-8905-44a9-8ef5-eac1242b5f32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:23.268595 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b537098-8905-44a9-8ef5-eac1242b5f32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:23.269442 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3b537098-8905-44a9-8ef5-eac1242b5f32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:23.586564 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3b537098-8905-44a9-8ef5-eac1242b5f32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:23.603085 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3b537098-8905-44a9-8ef5-eac1242b5f32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1546 microversion: 2.1 time: 0.359193 Oct 20 13:40:23.611418 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 337/641] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:23 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1546 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:23.633364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9eef0f2e-ceb6-46d6-83d3-0c3bdaebd964 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:23.634420 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9eef0f2e-ceb6-46d6-83d3-0c3bdaebd964 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:23.652750 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9eef0f2e-ceb6-46d6-83d3-0c3bdaebd964 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:23.653298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9eef0f2e-ceb6-46d6-83d3-0c3bdaebd964 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:23.653693 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9eef0f2e-ceb6-46d6-83d3-0c3bdaebd964 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:23.655858 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9eef0f2e-ceb6-46d6-83d3-0c3bdaebd964 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:23.656401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9eef0f2e-ceb6-46d6-83d3-0c3bdaebd964 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:23.656829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9eef0f2e-ceb6-46d6-83d3-0c3bdaebd964 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:23.861196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9eef0f2e-ceb6-46d6-83d3-0c3bdaebd964 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.231936 Oct 20 13:40:23.862022 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 305/642] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 20 13:40:23 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-interface => generated 284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:40:23.980700 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9d3b7f6f-e69d-4c26-8f41-5512a1d4bcae tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:23.981734 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9d3b7f6f-e69d-4c26-8f41-5512a1d4bcae tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:23.992326 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d3b7f6f-e69d-4c26-8f41-5512a1d4bcae tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:23.992820 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d3b7f6f-e69d-4c26-8f41-5512a1d4bcae tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:23.993290 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d3b7f6f-e69d-4c26-8f41-5512a1d4bcae tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:23.997981 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d3b7f6f-e69d-4c26-8f41-5512a1d4bcae tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:23.998465 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d3b7f6f-e69d-4c26-8f41-5512a1d4bcae tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:24.001013 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9d3b7f6f-e69d-4c26-8f41-5512a1d4bcae tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:24.529605 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9d3b7f6f-e69d-4c26-8f41-5512a1d4bcae tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:24.542495 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9d3b7f6f-e69d-4c26-8f41-5512a1d4bcae tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.567215 Oct 20 13:40:24.556893 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 338/643] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:23 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:24.904947 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-8f5122ad-2333-4173-ab93-6c85107dad6e req-7dcaa188-013a-4c49-b46f-bcc502c487a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34aa5d9-ed42-4cdd-bed0-229455d27cf1", "tag": "220d420d-8061-47e0-9323-3ec3344c20c6"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:24.924580 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-8f5122ad-2333-4173-ab93-6c85107dad6e req-7dcaa188-013a-4c49-b46f-bcc502c487a9 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:24.925016 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-8f5122ad-2333-4173-ab93-6c85107dad6e req-7dcaa188-013a-4c49-b46f-bcc502c487a9 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:24.925449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-8f5122ad-2333-4173-ab93-6c85107dad6e req-7dcaa188-013a-4c49-b46f-bcc502c487a9 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:24.949977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-8f5122ad-2333-4173-ab93-6c85107dad6e req-7dcaa188-013a-4c49-b46f-bcc502c487a9 service nova] Creating event network-changed:220d420d-8061-47e0-9323-3ec3344c20c6 for instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 on hv-cinder-86213 Oct 20 13:40:24.967797 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-8f5122ad-2333-4173-ab93-6c85107dad6e req-7dcaa188-013a-4c49-b46f-bcc502c487a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068255 Oct 20 13:40:24.969321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 306/644] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:40:25.570131 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-faa21796-1548-40e7-adb4-c20a4249980a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:25.571581 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-faa21796-1548-40e7-adb4-c20a4249980a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:25.583033 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-faa21796-1548-40e7-adb4-c20a4249980a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:25.583804 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-faa21796-1548-40e7-adb4-c20a4249980a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:25.588957 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-faa21796-1548-40e7-adb4-c20a4249980a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:25.590243 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-faa21796-1548-40e7-adb4-c20a4249980a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:25.590887 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-faa21796-1548-40e7-adb4-c20a4249980a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:25.591695 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-faa21796-1548-40e7-adb4-c20a4249980a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:25.925666 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-faa21796-1548-40e7-adb4-c20a4249980a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:25.940184 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-faa21796-1548-40e7-adb4-c20a4249980a tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.369420 Oct 20 13:40:25.941640 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 339/645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:25 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:26.967141 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-118e207a-ed1c-444f-a880-79237be48d2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:26.968432 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-118e207a-ed1c-444f-a880-79237be48d2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:26.975917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118e207a-ed1c-444f-a880-79237be48d2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:26.976596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118e207a-ed1c-444f-a880-79237be48d2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:26.977054 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118e207a-ed1c-444f-a880-79237be48d2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:26.977962 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118e207a-ed1c-444f-a880-79237be48d2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:26.978586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118e207a-ed1c-444f-a880-79237be48d2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:26.979000 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-118e207a-ed1c-444f-a880-79237be48d2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:26.994912 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-1a01ca87-d594-45ee-b2f9-c3a4d01aebd3 req-6266e09b-3beb-460a-a1e0-660949c6dd2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d730923-3277-4e78-9365-a95c403e26d8", "tag": "4c0b67a4-d502-4fe0-8fb2-21290e8ba8ea"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:27.009919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-1a01ca87-d594-45ee-b2f9-c3a4d01aebd3 req-6266e09b-3beb-460a-a1e0-660949c6dd2e service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:27.010448 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-1a01ca87-d594-45ee-b2f9-c3a4d01aebd3 req-6266e09b-3beb-460a-a1e0-660949c6dd2e service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:27.011181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-1a01ca87-d594-45ee-b2f9-c3a4d01aebd3 req-6266e09b-3beb-460a-a1e0-660949c6dd2e service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:27.023088 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-1a01ca87-d594-45ee-b2f9-c3a4d01aebd3 req-6266e09b-3beb-460a-a1e0-660949c6dd2e service nova] Creating event network-changed:4c0b67a4-d502-4fe0-8fb2-21290e8ba8ea for instance 3d730923-3277-4e78-9365-a95c403e26d8 on hv-cinder-86213 Oct 20 13:40:27.034138 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-1a01ca87-d594-45ee-b2f9-c3a4d01aebd3 req-6266e09b-3beb-460a-a1e0-660949c6dd2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045635 Oct 20 13:40:27.037926 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 340/646] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:40:27.193453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-118e207a-ed1c-444f-a880-79237be48d2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:27.209503 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-118e207a-ed1c-444f-a880-79237be48d2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1735 microversion: 2.1 time: 0.247177 Oct 20 13:40:27.211144 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 307/647] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:26 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:28.239722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9e59a621-0baa-453c-9ddf-733eafd5cc42 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:28.240997 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9e59a621-0baa-453c-9ddf-733eafd5cc42 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:28.263328 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e59a621-0baa-453c-9ddf-733eafd5cc42 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:28.263826 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e59a621-0baa-453c-9ddf-733eafd5cc42 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:28.265959 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e59a621-0baa-453c-9ddf-733eafd5cc42 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:28.267026 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e59a621-0baa-453c-9ddf-733eafd5cc42 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:28.267696 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e59a621-0baa-453c-9ddf-733eafd5cc42 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:28.268337 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9e59a621-0baa-453c-9ddf-733eafd5cc42 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:28.795751 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9e59a621-0baa-453c-9ddf-733eafd5cc42 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:28.805580 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9e59a621-0baa-453c-9ddf-733eafd5cc42 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1715 microversion: 2.1 time: 0.574181 Oct 20 13:40:28.806405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 341/648] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:28 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1715 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:28.953626 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:28.954441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:28.961511 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:28.962006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:28.962444 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:28.963150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:28.963602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:28.964029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:29.208241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] HTTP exception thrown: Cannot 'detach_volume' instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 while it is in vm_state rescued Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Request method failure captured: Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments/b0bf67ff-710d-4558-8467-6a869ea6d959 HTTP/1.1 Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU8EDd2vvUkyylhpotEJuKhlQDubD9a2W47vQITa7_dG2nMwmvFN7_QN2e2GI7GmwXpvLgSDZL0hzO6FAo5Na9GQVkD2x8Dg10Cs_2xd4l6hUlYtTtVpt4tIrTj8WeaKunzXxZGIY1rQk91fRfU3fGLHySl-I-o-9dOdjyRaOjT2KAc Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: f36e9fb394944eb0a0c2c0075dbc937c Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:40:29.210756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: f36e9fb394944eb0a0c2c0075dbc937c Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-ServerRescueNegativeTestJSON-1341728080-project Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 2dd45d3b097c46c28eb94c5e0bd2a7a6 Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1341728080-project Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:40:29.212058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Cannot 'detach_volume' instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 while it is in vm_state rescued Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'server_id': '5f326ad5-ca2f-4300-8676-2b6d7edfb108', 'id': 'b0bf67ff-710d-4558-8467-6a869ea6d959'} Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:40:29.213031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 while it is in vm_state rescued Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 while it is in vm_state rescued Oct 20 13:40:29.214445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:29.219624 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Returning 409 to user: Cannot 'detach_volume' instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 while it is in vm_state rescued {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:40:29.221127 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-81593e55-f5f6-463e-abb6-94b26fac0aa1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments/b0bf67ff-710d-4558-8467-6a869ea6d959" status: 409 len: 152 microversion: 2.1 time: 0.272512 Oct 20 13:40:29.221922 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 308/649] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:40:28 2022] DELETE /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments/b0bf67ff-710d-4558-8467-6a869ea6d959 => generated 152 bytes in 274 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 20 13:40:29.231138 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-1b9ae22c-e537-4ee1-847f-5bc79dc32c76 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:29.232023 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-1b9ae22c-e537-4ee1-847f-5bc79dc32c76 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:29.241599 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b9ae22c-e537-4ee1-847f-5bc79dc32c76 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:29.242888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b9ae22c-e537-4ee1-847f-5bc79dc32c76 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:29.243574 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b9ae22c-e537-4ee1-847f-5bc79dc32c76 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:29.244532 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b9ae22c-e537-4ee1-847f-5bc79dc32c76 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:29.245255 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b9ae22c-e537-4ee1-847f-5bc79dc32c76 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:29.245936 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1b9ae22c-e537-4ee1-847f-5bc79dc32c76 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:29.336817 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-1b9ae22c-e537-4ee1-847f-5bc79dc32c76 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "POST /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/action" status: 202 len: 0 microversion: 2.1 time: 0.110057 Oct 20 13:40:29.340627 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 342/650] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:40:29 2022] POST /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:40:29.346627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-baa87714-1a5f-4fde-9bdb-b82cb808525b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:29.347376 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-baa87714-1a5f-4fde-9bdb-b82cb808525b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:29.360806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-baa87714-1a5f-4fde-9bdb-b82cb808525b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:29.361720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-baa87714-1a5f-4fde-9bdb-b82cb808525b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:29.362578 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-baa87714-1a5f-4fde-9bdb-b82cb808525b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:29.363310 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-baa87714-1a5f-4fde-9bdb-b82cb808525b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:29.364201 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-baa87714-1a5f-4fde-9bdb-b82cb808525b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:29.364626 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-baa87714-1a5f-4fde-9bdb-b82cb808525b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:29.653877 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-baa87714-1a5f-4fde-9bdb-b82cb808525b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:29.663217 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-baa87714-1a5f-4fde-9bdb-b82cb808525b tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1723 microversion: 2.1 time: 0.321148 Oct 20 13:40:29.664029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 309/651] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:29 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:30.166204 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-ce81b428-5e29-4f36-974e-442f46d194af tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:30.166708 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-ce81b428-5e29-4f36-974e-442f46d194af tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:30.190350 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ce81b428-5e29-4f36-974e-442f46d194af tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:30.190858 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ce81b428-5e29-4f36-974e-442f46d194af tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:30.191300 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ce81b428-5e29-4f36-974e-442f46d194af tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:30.192018 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ce81b428-5e29-4f36-974e-442f46d194af tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:30.192637 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ce81b428-5e29-4f36-974e-442f46d194af tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:30.193246 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-ce81b428-5e29-4f36-974e-442f46d194af tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:30.221509 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-ce81b428-5e29-4f36-974e-442f46d194af tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/ips" status: 200 len: 148 microversion: 2.1 time: 0.059860 Oct 20 13:40:30.222410 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 343/652] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 20 13:40:30 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/ips => generated 148 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:30.688601 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8d452dfd-de80-4990-b466-bce78a5596f2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:30.689138 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8d452dfd-de80-4990-b466-bce78a5596f2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:30.695925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d452dfd-de80-4990-b466-bce78a5596f2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:30.696414 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d452dfd-de80-4990-b466-bce78a5596f2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:30.696844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d452dfd-de80-4990-b466-bce78a5596f2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:30.697575 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d452dfd-de80-4990-b466-bce78a5596f2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:30.698020 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d452dfd-de80-4990-b466-bce78a5596f2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:30.698441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d452dfd-de80-4990-b466-bce78a5596f2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:30.846700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8d452dfd-de80-4990-b466-bce78a5596f2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:30.865325 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8d452dfd-de80-4990-b466-bce78a5596f2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1723 microversion: 2.1 time: 0.180839 Oct 20 13:40:30.866036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 310/653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:30 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:31.654276 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9530505a-f403-43b4-8f20-5b0184b16adb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8998cdd9-374d-401b-852b-435c65975226"}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:31.659300 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9530505a-f403-43b4-8f20-5b0184b16adb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:31.666254 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9530505a-f403-43b4-8f20-5b0184b16adb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:31.666737 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9530505a-f403-43b4-8f20-5b0184b16adb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:31.667203 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9530505a-f403-43b4-8f20-5b0184b16adb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:31.667934 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9530505a-f403-43b4-8f20-5b0184b16adb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:31.668392 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9530505a-f403-43b4-8f20-5b0184b16adb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:31.668818 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9530505a-f403-43b4-8f20-5b0184b16adb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:31.906965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b26f6acc-daf9-4604-a9b1-5b7f6616cb32 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:31.907598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b26f6acc-daf9-4604-a9b1-5b7f6616cb32 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:31.925448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b26f6acc-daf9-4604-a9b1-5b7f6616cb32 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:31.926047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b26f6acc-daf9-4604-a9b1-5b7f6616cb32 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:31.926543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b26f6acc-daf9-4604-a9b1-5b7f6616cb32 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:31.927334 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b26f6acc-daf9-4604-a9b1-5b7f6616cb32 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:31.927844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b26f6acc-daf9-4604-a9b1-5b7f6616cb32 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:31.928488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b26f6acc-daf9-4604-a9b1-5b7f6616cb32 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:32.110326 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b26f6acc-daf9-4604-a9b1-5b7f6616cb32 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:32.119650 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b26f6acc-daf9-4604-a9b1-5b7f6616cb32 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1729 microversion: 2.1 time: 0.232560 Oct 20 13:40:32.120242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 311/654] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:31 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:32.144042 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8d24a124-531c-4c00-8075-b0e71d7e02e1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:32.144530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8d24a124-531c-4c00-8075-b0e71d7e02e1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:32.150726 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d24a124-531c-4c00-8075-b0e71d7e02e1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:32.151453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d24a124-531c-4c00-8075-b0e71d7e02e1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:32.152053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d24a124-531c-4c00-8075-b0e71d7e02e1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:32.152740 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d24a124-531c-4c00-8075-b0e71d7e02e1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:32.153213 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d24a124-531c-4c00-8075-b0e71d7e02e1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:32.153629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8d24a124-531c-4c00-8075-b0e71d7e02e1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:32.283984 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8d24a124-531c-4c00-8075-b0e71d7e02e1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144237 Oct 20 13:40:32.285002 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 312/655] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 20 13:40:32 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:32.495007 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9530505a-f403-43b4-8f20-5b0184b16adb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844363 Oct 20 13:40:32.496438 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 344/656] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:40:31 2022] POST /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:40:33.759928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-ad1e78ae-fcdd-48c5-9b4b-3d201fa25625 req-fd25516b-b6e6-4fc9-9002-e6bb4621c130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f326ad5-ca2f-4300-8676-2b6d7edfb108", "tag": "61a2cacd-9e95-4421-956a-22d6ee9a27a3"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:33.771284 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ad1e78ae-fcdd-48c5-9b4b-3d201fa25625 req-fd25516b-b6e6-4fc9-9002-e6bb4621c130 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:33.772448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ad1e78ae-fcdd-48c5-9b4b-3d201fa25625 req-fd25516b-b6e6-4fc9-9002-e6bb4621c130 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:33.773137 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ad1e78ae-fcdd-48c5-9b4b-3d201fa25625 req-fd25516b-b6e6-4fc9-9002-e6bb4621c130 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:33.786407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-ad1e78ae-fcdd-48c5-9b4b-3d201fa25625 req-fd25516b-b6e6-4fc9-9002-e6bb4621c130 service nova] Creating event network-changed:61a2cacd-9e95-4421-956a-22d6ee9a27a3 for instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 on hv-cinder-86213 Oct 20 13:40:33.791978 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-ad1e78ae-fcdd-48c5-9b4b-3d201fa25625 req-fd25516b-b6e6-4fc9-9002-e6bb4621c130 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036391 Oct 20 13:40:33.795902 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 313/657] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:35.807726 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-0ea78dae-d3c1-4ac0-9763-41840d9f5904 req-6b01c919-f5b2-4de7-80b5-a6635d9cccbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f326ad5-ca2f-4300-8676-2b6d7edfb108", "tag": "61a2cacd-9e95-4421-956a-22d6ee9a27a3"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:35.836057 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-0ea78dae-d3c1-4ac0-9763-41840d9f5904 req-6b01c919-f5b2-4de7-80b5-a6635d9cccbb service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:35.836580 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-0ea78dae-d3c1-4ac0-9763-41840d9f5904 req-6b01c919-f5b2-4de7-80b5-a6635d9cccbb service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:35.836994 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-0ea78dae-d3c1-4ac0-9763-41840d9f5904 req-6b01c919-f5b2-4de7-80b5-a6635d9cccbb service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:35.855915 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-0ea78dae-d3c1-4ac0-9763-41840d9f5904 req-6b01c919-f5b2-4de7-80b5-a6635d9cccbb service nova] Creating event network-changed:61a2cacd-9e95-4421-956a-22d6ee9a27a3 for instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 on hv-cinder-86213 Oct 20 13:40:35.869521 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-0ea78dae-d3c1-4ac0-9763-41840d9f5904 req-6b01c919-f5b2-4de7-80b5-a6635d9cccbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064063 Oct 20 13:40:35.872066 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 345/658] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:37.951085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f585e314-3383-424c-b608-fccae2986822 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Action: 'create', calling method: .version_select at 0x7ffa12c91700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1810721168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHg7b3Jkp3wv2slOKfuiW5GCYGpgLLQgr5+4CbhWgx98mbbmhkiACdsVD1/MoJWRwZREtwIUMVddB8vzxvwAyQUfhnytXsdjXqg5+gYoolqf/Co8MqmbVhSODpD+BcmYtw=="}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:37.957171 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:37.970316 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-f585e314-3383-424c-b608-fccae2986822 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Getting quotas for project accdb851c01342d49228faa016ff430c. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:40:37.974140 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-f585e314-3383-424c-b608-fccae2986822 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Getting quotas for user ce7ce255f03e4d999ff111ccf3a799d7 and project accdb851c01342d49228faa016ff430c. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:40:37.995995 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f585e314-3383-424c-b608-fccae2986822 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049508 Oct 20 13:40:37.996832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 314/659] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 20 13:40:37 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:38.049631 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-689834449", "imageRef": "577d7b0e-6c62-48a2-9a19-23cda238d678", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1810721168", "networks": [{"uuid": "90f6ed8e-98d1-4717-a988-12e9beb2cc56"}]}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:38.100812 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.network.neutron [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] validate_networks() for [('90f6ed8e-98d1-4717-a988-12e9beb2cc56', None, None, None, None, None)] {{(pid=125447) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:40:38.460004 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Flavor limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:40:38.460362 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Image limits 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:40:38.460819 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Flavor pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:40:38.461245 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Image pref 0:0:0 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:40:38.461647 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.virt.hardware [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:40:38.470785 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:38.471330 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:38.471758 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:38.472466 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:38.472937 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:38.473352 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:38.490643 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Getting quotas for project accdb851c01342d49228faa016ff430c. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:40:38.494594 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.quota [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Getting quotas for user ce7ce255f03e4d999ff111ccf3a799d7 and project accdb851c01342d49228faa016ff430c. Resources: {'instances', 'ram', 'cores'} {{(pid=125447) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:40:38.509335 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Going to run 1 instances... {{(pid=125447) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:40:38.511789 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='577d7b0e-6c62-48a2-9a19-23cda238d678',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125447) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:40:38.559274 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-5162c18f-74d0-44b2-a501-5a28a44e7d39 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514853 Oct 20 13:40:38.559922 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 346/660] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 13:40:38.571371 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e96f8563-8177-4006-bb2d-28cdff195a6e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:38.572246 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e96f8563-8177-4006-bb2d-28cdff195a6e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:38.651902 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e96f8563-8177-4006-bb2d-28cdff195a6e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:38.662441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e96f8563-8177-4006-bb2d-28cdff195a6e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1258 microversion: 2.1 time: 0.095024 Oct 20 13:40:38.663238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 315/661] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:38 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1258 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:39.686352 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-a1f26dde-861e-427c-b2a2-4a4d3914c970 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:39.686971 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-a1f26dde-861e-427c-b2a2-4a4d3914c970 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:39.693937 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a1f26dde-861e-427c-b2a2-4a4d3914c970 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:39.694421 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a1f26dde-861e-427c-b2a2-4a4d3914c970 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:39.694852 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a1f26dde-861e-427c-b2a2-4a4d3914c970 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:39.695537 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a1f26dde-861e-427c-b2a2-4a4d3914c970 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:39.695995 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a1f26dde-861e-427c-b2a2-4a4d3914c970 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:39.696417 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-a1f26dde-861e-427c-b2a2-4a4d3914c970 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:39.758324 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-a1f26dde-861e-427c-b2a2-4a4d3914c970 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:39.765880 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-a1f26dde-861e-427c-b2a2-4a4d3914c970 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1310 microversion: 2.1 time: 0.083991 Oct 20 13:40:39.766434 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 347/662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:39 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:40.250658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8998cdd9-374d-401b-852b-435c65975226"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:40.253183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:40.260500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:40.261299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:40.261786 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:40.262695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:40.263150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:40.263754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:40.353630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Invalid volume: volume 8998cdd9-374d-401b-852b-435c65975226 is already attached to instances: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: POST /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments HTTP/1.1 Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 74 Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:40:40.355348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {"volumeAttachment": {"volumeId": "8998cdd9-374d-401b-852b-435c65975226"}} Oct 20 13:40:40.356852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Invalid volume: volume 8998cdd9-374d-401b-852b-435c65975226 is already attached to instances: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'server_id': '29e3dc4f-68fd-40c3-a6db-6a36405b78b8', 'body': {'volumeAttachment': {'volumeId': '8998cdd9-374d-401b-852b-435c65975226'}}} Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8998cdd9-374d-401b-852b-435c65975226 is already attached to instances: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:40.357695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8998cdd9-374d-401b-852b-435c65975226 is already attached to instances: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:40.358909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:40:40.360072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:40:40.360072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:40:40.360072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:40:40.360072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8998cdd9-374d-401b-852b-435c65975226 is already attached to instances: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 Oct 20 13:40:40.360072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:40:40.360072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 400 to user: Invalid volume: volume 8998cdd9-374d-401b-852b-435c65975226 is already attached to instances: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:40:40.360072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-59ef9037-652c-42f9-8cec-278600422556 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110443 Oct 20 13:40:40.360072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 316/663] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:40:40 2022] POST /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 13:40:40.426902 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-683c73d9-9bf1-4735-b2ea-74d5b42bbaac tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:40.427337 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-683c73d9-9bf1-4735-b2ea-74d5b42bbaac tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:40.433264 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-683c73d9-9bf1-4735-b2ea-74d5b42bbaac tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:40.433744 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-683c73d9-9bf1-4735-b2ea-74d5b42bbaac tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:40.434365 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-683c73d9-9bf1-4735-b2ea-74d5b42bbaac tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:40.435060 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-683c73d9-9bf1-4735-b2ea-74d5b42bbaac tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:40.435512 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-683c73d9-9bf1-4735-b2ea-74d5b42bbaac tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:40.435934 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-683c73d9-9bf1-4735-b2ea-74d5b42bbaac tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:40.525713 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.objects.instance [None req-683c73d9-9bf1-4735-b2ea-74d5b42bbaac tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lazy-loading 'services' on Instance uuid 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 {{(pid=125447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:40:40.608914 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-683c73d9-9bf1-4735-b2ea-74d5b42bbaac tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments/8998cdd9-374d-401b-852b-435c65975226" status: 202 len: 0 microversion: 2.1 time: 0.187581 Oct 20 13:40:40.613882 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 348/664] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:40:40 2022] DELETE /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments/8998cdd9-374d-401b-852b-435c65975226 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:40:40.620252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c766f478-d2b9-4f8a-8dbb-19e9237216b3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:40.624445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c766f478-d2b9-4f8a-8dbb-19e9237216b3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:40.638736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c766f478-d2b9-4f8a-8dbb-19e9237216b3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:40.639532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c766f478-d2b9-4f8a-8dbb-19e9237216b3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:40.640279 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c766f478-d2b9-4f8a-8dbb-19e9237216b3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:40.641349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c766f478-d2b9-4f8a-8dbb-19e9237216b3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:40.642141 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c766f478-d2b9-4f8a-8dbb-19e9237216b3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:40.642691 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c766f478-d2b9-4f8a-8dbb-19e9237216b3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:40.695065 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c766f478-d2b9-4f8a-8dbb-19e9237216b3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078880 Oct 20 13:40:40.696255 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 317/665] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:40 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:40.790546 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9fc6703d-fe9a-45de-873e-8d885843a2bf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:40.791870 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9fc6703d-fe9a-45de-873e-8d885843a2bf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:40.806540 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9fc6703d-fe9a-45de-873e-8d885843a2bf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:40.807192 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9fc6703d-fe9a-45de-873e-8d885843a2bf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:40.807634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9fc6703d-fe9a-45de-873e-8d885843a2bf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:40.808389 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9fc6703d-fe9a-45de-873e-8d885843a2bf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:40.808840 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9fc6703d-fe9a-45de-873e-8d885843a2bf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:40.809331 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9fc6703d-fe9a-45de-873e-8d885843a2bf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:40.925380 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9fc6703d-fe9a-45de-873e-8d885843a2bf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:40.935562 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9fc6703d-fe9a-45de-873e-8d885843a2bf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1316 microversion: 2.1 time: 0.149560 Oct 20 13:40:40.936829 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 349/666] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:40 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:41.816844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-055d473e-b47a-403f-b53a-b7a871a17323 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:41.819165 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-055d473e-b47a-403f-b53a-b7a871a17323 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:41.826183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-055d473e-b47a-403f-b53a-b7a871a17323 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:41.826779 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-055d473e-b47a-403f-b53a-b7a871a17323 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:41.827290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-055d473e-b47a-403f-b53a-b7a871a17323 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:41.828047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-055d473e-b47a-403f-b53a-b7a871a17323 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:41.828596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-055d473e-b47a-403f-b53a-b7a871a17323 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:41.829222 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-055d473e-b47a-403f-b53a-b7a871a17323 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:41.863436 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-055d473e-b47a-403f-b53a-b7a871a17323 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157522 Oct 20 13:40:41.864378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 318/667] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:41 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:41.959531 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-9a6409dd-42f3-4011-8a65-d72ef7e34fba tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:41.960853 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-9a6409dd-42f3-4011-8a65-d72ef7e34fba tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:41.967770 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a6409dd-42f3-4011-8a65-d72ef7e34fba tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:41.968386 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a6409dd-42f3-4011-8a65-d72ef7e34fba tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:41.969040 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a6409dd-42f3-4011-8a65-d72ef7e34fba tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:41.969848 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a6409dd-42f3-4011-8a65-d72ef7e34fba tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:41.970364 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a6409dd-42f3-4011-8a65-d72ef7e34fba tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:41.971559 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-9a6409dd-42f3-4011-8a65-d72ef7e34fba tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:41.991521 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:42.116553 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-9a6409dd-42f3-4011-8a65-d72ef7e34fba tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:42.124856 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-9a6409dd-42f3-4011-8a65-d72ef7e34fba tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.169355 Oct 20 13:40:42.125453 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 350/668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:41 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:42.876657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d0f74dce-f324-4219-a96c-1204a43782da tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:42.879179 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d0f74dce-f324-4219-a96c-1204a43782da tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:42.886023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0f74dce-f324-4219-a96c-1204a43782da tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:42.886500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0f74dce-f324-4219-a96c-1204a43782da tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:42.886938 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0f74dce-f324-4219-a96c-1204a43782da tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:42.887620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0f74dce-f324-4219-a96c-1204a43782da tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:42.888065 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0f74dce-f324-4219-a96c-1204a43782da tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:42.888479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0f74dce-f324-4219-a96c-1204a43782da tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:42.921838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d0f74dce-f324-4219-a96c-1204a43782da tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049462 Oct 20 13:40:42.922398 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 319/669] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:42 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:43.149772 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-256219a7-a63e-4d60-bba9-89f95f9a183f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:43.150378 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-256219a7-a63e-4d60-bba9-89f95f9a183f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:43.157146 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-256219a7-a63e-4d60-bba9-89f95f9a183f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:43.157924 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-256219a7-a63e-4d60-bba9-89f95f9a183f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:43.159271 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-256219a7-a63e-4d60-bba9-89f95f9a183f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:43.160329 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-256219a7-a63e-4d60-bba9-89f95f9a183f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:43.161037 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-256219a7-a63e-4d60-bba9-89f95f9a183f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:43.161688 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-256219a7-a63e-4d60-bba9-89f95f9a183f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:43.303883 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-256219a7-a63e-4d60-bba9-89f95f9a183f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:43.311822 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-256219a7-a63e-4d60-bba9-89f95f9a183f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.165980 Oct 20 13:40:43.312405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 351/670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:43 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:43.934985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e0eb46d4-32b5-4d89-8807-54e4dac999cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:43.937185 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e0eb46d4-32b5-4d89-8807-54e4dac999cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:43.945340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0eb46d4-32b5-4d89-8807-54e4dac999cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:43.946557 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0eb46d4-32b5-4d89-8807-54e4dac999cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:43.947254 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0eb46d4-32b5-4d89-8807-54e4dac999cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:43.948095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0eb46d4-32b5-4d89-8807-54e4dac999cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:43.948618 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0eb46d4-32b5-4d89-8807-54e4dac999cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:43.949153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0eb46d4-32b5-4d89-8807-54e4dac999cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:43.980115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e0eb46d4-32b5-4d89-8807-54e4dac999cc tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048998 Oct 20 13:40:43.980670 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 320/671] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:43 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:44.337907 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0ee2d1fd-c068-45e4-b30e-c9e684cd096e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:44.338605 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0ee2d1fd-c068-45e4-b30e-c9e684cd096e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:44.345550 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee2d1fd-c068-45e4-b30e-c9e684cd096e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:44.346748 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee2d1fd-c068-45e4-b30e-c9e684cd096e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:44.347190 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee2d1fd-c068-45e4-b30e-c9e684cd096e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:44.347888 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee2d1fd-c068-45e4-b30e-c9e684cd096e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:44.348339 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee2d1fd-c068-45e4-b30e-c9e684cd096e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:44.348760 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0ee2d1fd-c068-45e4-b30e-c9e684cd096e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:44.492844 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0ee2d1fd-c068-45e4-b30e-c9e684cd096e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:44.501116 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0ee2d1fd-c068-45e4-b30e-c9e684cd096e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.167741 Oct 20 13:40:44.502230 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 352/672] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:44 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:44.993701 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6c6979f7-4e71-4ae4-9f83-ff86eaac8c04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:44.995824 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6c6979f7-4e71-4ae4-9f83-ff86eaac8c04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:45.002792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6c6979f7-4e71-4ae4-9f83-ff86eaac8c04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:45.003287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6c6979f7-4e71-4ae4-9f83-ff86eaac8c04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:45.003712 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6c6979f7-4e71-4ae4-9f83-ff86eaac8c04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:45.004403 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6c6979f7-4e71-4ae4-9f83-ff86eaac8c04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:45.004872 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6c6979f7-4e71-4ae4-9f83-ff86eaac8c04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:45.005308 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6c6979f7-4e71-4ae4-9f83-ff86eaac8c04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:45.022206 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=100 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:45.037474 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-6c6979f7-4e71-4ae4-9f83-ff86eaac8c04 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047643 Oct 20 13:40:45.038056 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 321/673] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:44 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:45.527589 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-35a82264-57f4-42cc-957f-4154f346d537 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:45.528197 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-35a82264-57f4-42cc-957f-4154f346d537 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:45.535863 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35a82264-57f4-42cc-957f-4154f346d537 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:45.536343 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35a82264-57f4-42cc-957f-4154f346d537 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:45.536781 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35a82264-57f4-42cc-957f-4154f346d537 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:45.537517 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35a82264-57f4-42cc-957f-4154f346d537 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:45.537982 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35a82264-57f4-42cc-957f-4154f346d537 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:45.538404 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-35a82264-57f4-42cc-957f-4154f346d537 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:45.672088 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-35a82264-57f4-42cc-957f-4154f346d537 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:45.680208 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-35a82264-57f4-42cc-957f-4154f346d537 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.156383 Oct 20 13:40:45.680934 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 353/674] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:45 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:46.050990 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9a35fd43-027f-484c-829f-6fae3fffb617 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:46.053065 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9a35fd43-027f-484c-829f-6fae3fffb617 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:46.059538 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a35fd43-027f-484c-829f-6fae3fffb617 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:46.060010 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a35fd43-027f-484c-829f-6fae3fffb617 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:46.060437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a35fd43-027f-484c-829f-6fae3fffb617 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:46.061158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a35fd43-027f-484c-829f-6fae3fffb617 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:46.061603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a35fd43-027f-484c-829f-6fae3fffb617 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:46.062019 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9a35fd43-027f-484c-829f-6fae3fffb617 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:46.097061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9a35fd43-027f-484c-829f-6fae3fffb617 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050832 Oct 20 13:40:46.099102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 322/675] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:46 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:46.703884 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6af55ce9-954b-4727-be4d-1909e338a335 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:46.704475 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-6af55ce9-954b-4727-be4d-1909e338a335 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:46.710990 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6af55ce9-954b-4727-be4d-1909e338a335 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:46.711497 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6af55ce9-954b-4727-be4d-1909e338a335 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:46.711948 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6af55ce9-954b-4727-be4d-1909e338a335 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:46.712746 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6af55ce9-954b-4727-be4d-1909e338a335 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:46.713333 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6af55ce9-954b-4727-be4d-1909e338a335 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:46.713797 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6af55ce9-954b-4727-be4d-1909e338a335 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:46.850645 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-6af55ce9-954b-4727-be4d-1909e338a335 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:46.858431 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-6af55ce9-954b-4727-be4d-1909e338a335 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.158526 Oct 20 13:40:46.859097 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 354/676] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:46 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:47.109703 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b9f2a4c2-324a-44c1-a28e-3db1bff804e2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:47.112125 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b9f2a4c2-324a-44c1-a28e-3db1bff804e2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:47.119659 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b9f2a4c2-324a-44c1-a28e-3db1bff804e2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:47.120145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b9f2a4c2-324a-44c1-a28e-3db1bff804e2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:47.120923 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b9f2a4c2-324a-44c1-a28e-3db1bff804e2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:47.121891 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b9f2a4c2-324a-44c1-a28e-3db1bff804e2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:47.122339 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b9f2a4c2-324a-44c1-a28e-3db1bff804e2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:47.122757 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b9f2a4c2-324a-44c1-a28e-3db1bff804e2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:47.152467 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b9f2a4c2-324a-44c1-a28e-3db1bff804e2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046712 Oct 20 13:40:47.153052 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 323/677] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:47 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:47.887800 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-31b59c52-0cf5-44e1-be12-f6b1ec71cc61 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:47.887800 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-31b59c52-0cf5-44e1-be12-f6b1ec71cc61 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:47.895220 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31b59c52-0cf5-44e1-be12-f6b1ec71cc61 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:47.895658 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31b59c52-0cf5-44e1-be12-f6b1ec71cc61 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:47.896448 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31b59c52-0cf5-44e1-be12-f6b1ec71cc61 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:47.897408 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31b59c52-0cf5-44e1-be12-f6b1ec71cc61 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:47.898113 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31b59c52-0cf5-44e1-be12-f6b1ec71cc61 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:47.898789 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-31b59c52-0cf5-44e1-be12-f6b1ec71cc61 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:48.031045 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-31b59c52-0cf5-44e1-be12-f6b1ec71cc61 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:48.040413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-31b59c52-0cf5-44e1-be12-f6b1ec71cc61 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.158597 Oct 20 13:40:48.040413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 355/678] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:47 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:48.164840 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7a5a6d12-8407-43a0-9d89-32475f8a9e28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:48.167145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7a5a6d12-8407-43a0-9d89-32475f8a9e28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:48.173608 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d12-8407-43a0-9d89-32475f8a9e28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:48.174085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d12-8407-43a0-9d89-32475f8a9e28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:48.174512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d12-8407-43a0-9d89-32475f8a9e28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:48.175812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d12-8407-43a0-9d89-32475f8a9e28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:48.176262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d12-8407-43a0-9d89-32475f8a9e28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:48.176678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d12-8407-43a0-9d89-32475f8a9e28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:48.210075 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7a5a6d12-8407-43a0-9d89-32475f8a9e28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049150 Oct 20 13:40:48.210660 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 324/679] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:48 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:49.061236 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-4d2d1996-fff2-4921-b7eb-c1985efe730c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:49.061835 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-4d2d1996-fff2-4921-b7eb-c1985efe730c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:49.063778 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=2 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:49.064634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell0:SELECT=6 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:49.072049 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d2d1996-fff2-4921-b7eb-c1985efe730c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:49.072652 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d2d1996-fff2-4921-b7eb-c1985efe730c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:49.073327 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d2d1996-fff2-4921-b7eb-c1985efe730c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:49.074233 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d2d1996-fff2-4921-b7eb-c1985efe730c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:49.074695 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d2d1996-fff2-4921-b7eb-c1985efe730c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:49.075127 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4d2d1996-fff2-4921-b7eb-c1985efe730c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:49.209660 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-4d2d1996-fff2-4921-b7eb-c1985efe730c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:49.217416 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-4d2d1996-fff2-4921-b7eb-c1985efe730c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.160091 Oct 20 13:40:49.218084 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 356/680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:49 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:49.222524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f8cf7557-c67d-48c7-817c-2b0c20bf5dca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:49.224652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f8cf7557-c67d-48c7-817c-2b0c20bf5dca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:49.226507 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=6 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:49.232002 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f8cf7557-c67d-48c7-817c-2b0c20bf5dca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:49.232479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f8cf7557-c67d-48c7-817c-2b0c20bf5dca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:49.232933 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f8cf7557-c67d-48c7-817c-2b0c20bf5dca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:49.233666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f8cf7557-c67d-48c7-817c-2b0c20bf5dca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:49.234112 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f8cf7557-c67d-48c7-817c-2b0c20bf5dca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:49.234532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f8cf7557-c67d-48c7-817c-2b0c20bf5dca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:49.267500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f8cf7557-c67d-48c7-817c-2b0c20bf5dca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048946 Oct 20 13:40:49.268054 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 325/681] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:49 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:40:50.239485 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-96f16f1a-3f7b-48a9-96b4-82f191c912cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:50.240743 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-96f16f1a-3f7b-48a9-96b4-82f191c912cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:50.247110 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96f16f1a-3f7b-48a9-96b4-82f191c912cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:50.247776 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96f16f1a-3f7b-48a9-96b4-82f191c912cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:50.248206 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96f16f1a-3f7b-48a9-96b4-82f191c912cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:50.248927 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96f16f1a-3f7b-48a9-96b4-82f191c912cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:50.249375 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96f16f1a-3f7b-48a9-96b4-82f191c912cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:50.249792 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-96f16f1a-3f7b-48a9-96b4-82f191c912cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:50.279839 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-75fba5c4-48d0-4dc4-a917-7b9ec97fb934 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:50.283395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-75fba5c4-48d0-4dc4-a917-7b9ec97fb934 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:50.300638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-75fba5c4-48d0-4dc4-a917-7b9ec97fb934 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:50.302346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-75fba5c4-48d0-4dc4-a917-7b9ec97fb934 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:50.303434 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-75fba5c4-48d0-4dc4-a917-7b9ec97fb934 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:50.307029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-75fba5c4-48d0-4dc4-a917-7b9ec97fb934 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:50.307669 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-75fba5c4-48d0-4dc4-a917-7b9ec97fb934 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:50.308280 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-75fba5c4-48d0-4dc4-a917-7b9ec97fb934 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:50.359956 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-75fba5c4-48d0-4dc4-a917-7b9ec97fb934 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084039 Oct 20 13:40:50.368980 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 326/682] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:50 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:40:50.391480 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-96f16f1a-3f7b-48a9-96b4-82f191c912cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:50.399828 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-96f16f1a-3f7b-48a9-96b4-82f191c912cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.164168 Oct 20 13:40:50.400405 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 357/683] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:50 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:50.546899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-50548189-2a9b-4386-a793-db17a0e2963b req-e7256fe5-8688-4c97-900b-33cbaac5efcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89b72ca-c19d-4976-97be-086660601e2b", "tag": "57704c11-9966-4dc7-ba8b-0af092c2b73f"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:50.557016 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-50548189-2a9b-4386-a793-db17a0e2963b req-e7256fe5-8688-4c97-900b-33cbaac5efcd service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:50.557490 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-50548189-2a9b-4386-a793-db17a0e2963b req-e7256fe5-8688-4c97-900b-33cbaac5efcd service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:50.557920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-50548189-2a9b-4386-a793-db17a0e2963b req-e7256fe5-8688-4c97-900b-33cbaac5efcd service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:50.568684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-50548189-2a9b-4386-a793-db17a0e2963b req-e7256fe5-8688-4c97-900b-33cbaac5efcd service nova] Creating event network-changed:57704c11-9966-4dc7-ba8b-0af092c2b73f for instance e89b72ca-c19d-4976-97be-086660601e2b on hv-cinder-86213 Oct 20 13:40:50.573660 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-50548189-2a9b-4386-a793-db17a0e2963b req-e7256fe5-8688-4c97-900b-33cbaac5efcd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030800 Oct 20 13:40:50.574437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 327/684] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:51.373573 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-4c52d4f5-d474-455f-8213-b0b2f0f96e56 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:51.375824 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-4c52d4f5-d474-455f-8213-b0b2f0f96e56 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:51.382594 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4c52d4f5-d474-455f-8213-b0b2f0f96e56 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:51.383086 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4c52d4f5-d474-455f-8213-b0b2f0f96e56 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:51.383524 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4c52d4f5-d474-455f-8213-b0b2f0f96e56 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:51.384228 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4c52d4f5-d474-455f-8213-b0b2f0f96e56 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:51.384682 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4c52d4f5-d474-455f-8213-b0b2f0f96e56 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:51.385139 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4c52d4f5-d474-455f-8213-b0b2f0f96e56 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:51.416464 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-4c52d4f5-d474-455f-8213-b0b2f0f96e56 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047095 Oct 20 13:40:51.418288 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 358/685] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:40:51 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 13:40:51.423804 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c37cf47c-2983-442b-8378-c05d05fd01d8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:51.424689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c37cf47c-2983-442b-8378-c05d05fd01d8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:51.431837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c37cf47c-2983-442b-8378-c05d05fd01d8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:51.432489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c37cf47c-2983-442b-8378-c05d05fd01d8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:51.433103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c37cf47c-2983-442b-8378-c05d05fd01d8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:51.433969 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c37cf47c-2983-442b-8378-c05d05fd01d8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:51.434412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c37cf47c-2983-442b-8378-c05d05fd01d8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:51.434829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c37cf47c-2983-442b-8378-c05d05fd01d8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:51.483079 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-1cce8a23-1600-450c-bf0f-cd5d26c3ddb4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:51.483653 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-1cce8a23-1600-450c-bf0f-cd5d26c3ddb4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:51.489977 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1cce8a23-1600-450c-bf0f-cd5d26c3ddb4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:51.490467 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1cce8a23-1600-450c-bf0f-cd5d26c3ddb4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:51.490904 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1cce8a23-1600-450c-bf0f-cd5d26c3ddb4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:51.491623 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1cce8a23-1600-450c-bf0f-cd5d26c3ddb4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:51.492063 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1cce8a23-1600-450c-bf0f-cd5d26c3ddb4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:51.492487 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-1cce8a23-1600-450c-bf0f-cd5d26c3ddb4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:51.524232 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-1cce8a23-1600-450c-bf0f-cd5d26c3ddb4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Going to try to terminate instance {{(pid=125447) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:40:51.600682 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-1cce8a23-1600-450c-bf0f-cd5d26c3ddb4 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 204 len: 0 microversion: 2.1 time: 0.121156 Oct 20 13:40:51.604373 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 359/686] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:40:51 2022] DELETE /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 20 13:40:51.610296 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-15a02656-b7ea-4071-a994-485b03d11210 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:51.611005 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-15a02656-b7ea-4071-a994-485b03d11210 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:51.618163 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15a02656-b7ea-4071-a994-485b03d11210 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:51.618651 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15a02656-b7ea-4071-a994-485b03d11210 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:51.619201 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15a02656-b7ea-4071-a994-485b03d11210 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:51.619904 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15a02656-b7ea-4071-a994-485b03d11210 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:51.620355 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15a02656-b7ea-4071-a994-485b03d11210 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:51.620774 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-15a02656-b7ea-4071-a994-485b03d11210 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:51.757569 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-15a02656-b7ea-4071-a994-485b03d11210 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:51.765981 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-15a02656-b7ea-4071-a994-485b03d11210 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1678 microversion: 2.1 time: 0.160153 Oct 20 13:40:51.766567 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 360/687] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:51 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:51.865463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c37cf47c-2983-442b-8378-c05d05fd01d8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:51.873392 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c37cf47c-2983-442b-8378-c05d05fd01d8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.453848 Oct 20 13:40:51.874074 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 328/688] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:51 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:52.790496 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-103a4ab0-78ad-4d84-b19c-8a2d17cc46e9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:52.791052 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-103a4ab0-78ad-4d84-b19c-8a2d17cc46e9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:52.793550 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:52.798837 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-103a4ab0-78ad-4d84-b19c-8a2d17cc46e9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:52.799319 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-103a4ab0-78ad-4d84-b19c-8a2d17cc46e9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:52.799755 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-103a4ab0-78ad-4d84-b19c-8a2d17cc46e9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:52.801121 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-103a4ab0-78ad-4d84-b19c-8a2d17cc46e9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:52.801680 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-103a4ab0-78ad-4d84-b19c-8a2d17cc46e9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:52.802110 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-103a4ab0-78ad-4d84-b19c-8a2d17cc46e9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:52.895929 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-09a7ca29-150f-4b95-9282-d848cae71f63 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:52.896543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-09a7ca29-150f-4b95-9282-d848cae71f63 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:52.903125 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09a7ca29-150f-4b95-9282-d848cae71f63 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:52.903612 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09a7ca29-150f-4b95-9282-d848cae71f63 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:52.904046 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09a7ca29-150f-4b95-9282-d848cae71f63 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:52.904740 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09a7ca29-150f-4b95-9282-d848cae71f63 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:52.905227 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09a7ca29-150f-4b95-9282-d848cae71f63 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:52.905657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09a7ca29-150f-4b95-9282-d848cae71f63 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:52.934739 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-103a4ab0-78ad-4d84-b19c-8a2d17cc46e9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:52.943234 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-103a4ab0-78ad-4d84-b19c-8a2d17cc46e9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1678 microversion: 2.1 time: 0.156681 Oct 20 13:40:52.943809 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 361/689] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:52 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:53.032102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-09a7ca29-150f-4b95-9282-d848cae71f63 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:53.041488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-09a7ca29-150f-4b95-9282-d848cae71f63 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.149274 Oct 20 13:40:53.042092 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 329/690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:52 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:53.966591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-d0e311e4-db84-4372-92d2-988b39c2939e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:53.967205 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-d0e311e4-db84-4372-92d2-988b39c2939e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:53.974042 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d0e311e4-db84-4372-92d2-988b39c2939e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:53.974523 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d0e311e4-db84-4372-92d2-988b39c2939e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:53.974957 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d0e311e4-db84-4372-92d2-988b39c2939e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:53.975642 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d0e311e4-db84-4372-92d2-988b39c2939e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:53.976089 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d0e311e4-db84-4372-92d2-988b39c2939e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:53.976515 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-d0e311e4-db84-4372-92d2-988b39c2939e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:54.065507 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-10c005e1-e6ae-4896-b208-801ae79abf1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:54.066785 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-10c005e1-e6ae-4896-b208-801ae79abf1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:54.073245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-10c005e1-e6ae-4896-b208-801ae79abf1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:54.073726 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-10c005e1-e6ae-4896-b208-801ae79abf1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:54.074150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-10c005e1-e6ae-4896-b208-801ae79abf1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:54.074837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-10c005e1-e6ae-4896-b208-801ae79abf1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:54.075278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-10c005e1-e6ae-4896-b208-801ae79abf1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:54.075690 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-10c005e1-e6ae-4896-b208-801ae79abf1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:54.102645 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-d0e311e4-db84-4372-92d2-988b39c2939e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:54.110333 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-d0e311e4-db84-4372-92d2-988b39c2939e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1678 microversion: 2.1 time: 0.147609 Oct 20 13:40:54.111003 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 362/691] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:53 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:54.210432 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-10c005e1-e6ae-4896-b208-801ae79abf1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:54.217990 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-10c005e1-e6ae-4896-b208-801ae79abf1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.156306 Oct 20 13:40:54.218547 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 330/692] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:54 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:55.136360 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-db89b4f3-e24a-42b0-857c-597bfc164bca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:55.138963 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-db89b4f3-e24a-42b0-857c-597bfc164bca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:55.147277 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db89b4f3-e24a-42b0-857c-597bfc164bca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:55.147813 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db89b4f3-e24a-42b0-857c-597bfc164bca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:55.148399 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db89b4f3-e24a-42b0-857c-597bfc164bca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:55.149312 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db89b4f3-e24a-42b0-857c-597bfc164bca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:55.149774 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db89b4f3-e24a-42b0-857c-597bfc164bca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:55.150202 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-db89b4f3-e24a-42b0-857c-597bfc164bca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:55.157794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-a0f80566-477b-48b3-9a2f-c95944327a90 req-bda982af-120b-40b1-90dd-e8c3db56aa8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e3dc4f-68fd-40c3-a6db-6a36405b78b8", "name": "network-vif-deleted", "tag": "ab360a6b-2b2e-4e3a-9f55-9efb2ef8c2f8"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:55.173631 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-a0f80566-477b-48b3-9a2f-c95944327a90 req-bda982af-120b-40b1-90dd-e8c3db56aa8c service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:55.174404 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-a0f80566-477b-48b3-9a2f-c95944327a90 req-bda982af-120b-40b1-90dd-e8c3db56aa8c service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:55.174825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-a0f80566-477b-48b3-9a2f-c95944327a90 req-bda982af-120b-40b1-90dd-e8c3db56aa8c service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:55.188837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-a0f80566-477b-48b3-9a2f-c95944327a90 req-bda982af-120b-40b1-90dd-e8c3db56aa8c service nova] Creating event network-vif-deleted:ab360a6b-2b2e-4e3a-9f55-9efb2ef8c2f8 for instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 on hv-cinder-86213 Oct 20 13:40:55.194540 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-a0f80566-477b-48b3-9a2f-c95944327a90 req-bda982af-120b-40b1-90dd-e8c3db56aa8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040324 Oct 20 13:40:55.195737 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 331/693] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:55.240310 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-85d0c7cd-2b94-408f-a6c7-08900b028ddd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:55.241063 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-85d0c7cd-2b94-408f-a6c7-08900b028ddd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:55.241669 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-db89b4f3-e24a-42b0-857c-597bfc164bca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:55.249982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-85d0c7cd-2b94-408f-a6c7-08900b028ddd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:55.250472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-85d0c7cd-2b94-408f-a6c7-08900b028ddd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:55.250905 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-85d0c7cd-2b94-408f-a6c7-08900b028ddd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:55.251609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-85d0c7cd-2b94-408f-a6c7-08900b028ddd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:55.252055 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-85d0c7cd-2b94-408f-a6c7-08900b028ddd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:55.252469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-85d0c7cd-2b94-408f-a6c7-08900b028ddd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:55.256193 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-db89b4f3-e24a-42b0-857c-597bfc164bca tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 200 len: 1611 microversion: 2.1 time: 0.123375 Oct 20 13:40:55.261239 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 363/694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:55 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 1611 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:55.430562 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-85d0c7cd-2b94-408f-a6c7-08900b028ddd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:55.438808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-85d0c7cd-2b94-408f-a6c7-08900b028ddd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.202941 Oct 20 13:40:55.439375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 332/695] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:55 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:56.281315 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:56.281917 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:56.289049 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:56.289522 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:56.289948 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:56.290621 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:56.291064 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:56.291477 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:56.305192 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.wsgi [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: request: GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 HTTP/1.1 Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept: application/json Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Accept-Encoding: identity Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Connection: close Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Length: 0 Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Content-Type: application/json Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Host: 10.222.0.23 Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Openstack-System-Scope: None Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: User-Agent: python-urllib3/1.26.12 Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Id: None Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Domain-Name: None Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Identity-Status: Confirmed Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Is-Admin-Project: True Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Id: default Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Domain-Name: Default Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Role: member,reader Oct 20 13:40:56.306795 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Roles: member,reader Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Id: default Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Domain-Name: Default Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: method: > Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: exception: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:40:56.308361 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: action_args: {'id': '29e3dc4f-68fd-40c3-a6db-6a36405b78b8'} Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:40:56.309194 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:40:56.310463 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: ERROR nova.api.openstack.wsgi Oct 20 13:40:56.311617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. {{(pid=125447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:40:56.311617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-e213f352-0724-454d-9af2-9ff30f0aa6d7 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 404 len: 111 microversion: 2.1 time: 0.030680 Oct 20 13:40:56.311617 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 364/696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:56 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:40:56.316947 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-26d69833-9dfe-40ce-82ab-3e8423ada7e3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '.version_select at 0x7ffa12d4b4c0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:56.335238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-26d69833-9dfe-40ce-82ab-3e8423ada7e3 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-745065976" status: 202 len: 0 microversion: 2.1 time: 0.022141 Oct 20 13:40:56.335784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 333/697] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 20 13:40:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-745065976 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:40:56.463320 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-552d8530-b405-4d0b-803c-06902e28a247 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:56.463974 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-552d8530-b405-4d0b-803c-06902e28a247 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:56.470618 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-552d8530-b405-4d0b-803c-06902e28a247 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:56.471101 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-552d8530-b405-4d0b-803c-06902e28a247 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:56.471531 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-552d8530-b405-4d0b-803c-06902e28a247 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:56.472963 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-552d8530-b405-4d0b-803c-06902e28a247 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:56.473578 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-552d8530-b405-4d0b-803c-06902e28a247 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:56.474112 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-552d8530-b405-4d0b-803c-06902e28a247 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:56.737101 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-552d8530-b405-4d0b-803c-06902e28a247 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:56.744695 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-552d8530-b405-4d0b-803c-06902e28a247 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.285662 Oct 20 13:40:56.745280 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 365/698] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:56 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:57.027136 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-522d9b85-caef-4657-8fc1-6f39d8f17c80 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: .version_select at 0x7ffa12c915e0>, body: {"keypair": {"name": "tempest-keypair-1081126730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+jLjiLw9gfLMa70vsZJMEEwEKKxqrf4IFX5UFPvGvr4MGHfTAKmFcnarsqpK+BtUCLLKW1cCshEQ0q7eo6ixqw0X/RsO5dBvk6dkYRqOvukBSHzhBjj5P+Vx3sHszJLA=="}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:57.043232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-522d9b85-caef-4657-8fc1-6f39d8f17c80 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for project b215cb88123a4851932dbf7dfa88f709. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:40:57.047035 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-522d9b85-caef-4657-8fc1-6f39d8f17c80 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for user 144e9801ac1f470083d11647652ccdf1 and project b215cb88123a4851932dbf7dfa88f709. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:40:57.068631 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-522d9b85-caef-4657-8fc1-6f39d8f17c80 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045389 Oct 20 13:40:57.069254 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 334/699] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 20 13:40:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:40:57.767826 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-7060f057-7462-4f9b-9ba2-03ea0b8d9e5d tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:57.768442 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-7060f057-7462-4f9b-9ba2-03ea0b8d9e5d tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:57.777432 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7060f057-7462-4f9b-9ba2-03ea0b8d9e5d tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:57.777929 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7060f057-7462-4f9b-9ba2-03ea0b8d9e5d tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:57.778400 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7060f057-7462-4f9b-9ba2-03ea0b8d9e5d tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:57.779061 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7060f057-7462-4f9b-9ba2-03ea0b8d9e5d tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:57.779510 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7060f057-7462-4f9b-9ba2-03ea0b8d9e5d tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:57.779928 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-7060f057-7462-4f9b-9ba2-03ea0b8d9e5d tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:57.784312 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:57.950634 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-7060f057-7462-4f9b-9ba2-03ea0b8d9e5d tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:57.960738 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-7060f057-7462-4f9b-9ba2-03ea0b8d9e5d tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.197016 Oct 20 13:40:57.961652 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 366/700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:57 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:40:58.141179 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c5beecd3-89ab-4039-aadd-96e3c7093168 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:58.141787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c5beecd3-89ab-4039-aadd-96e3c7093168 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:58.149938 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c5beecd3-89ab-4039-aadd-96e3c7093168 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:58.150431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c5beecd3-89ab-4039-aadd-96e3c7093168 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:58.150864 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c5beecd3-89ab-4039-aadd-96e3c7093168 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:58.151576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c5beecd3-89ab-4039-aadd-96e3c7093168 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:58.152032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c5beecd3-89ab-4039-aadd-96e3c7093168 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:58.152546 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c5beecd3-89ab-4039-aadd-96e3c7093168 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:58.183920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c5beecd3-89ab-4039-aadd-96e3c7093168 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:40:58.268002 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c5beecd3-89ab-4039-aadd-96e3c7093168 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 204 len: 0 microversion: 2.1 time: 0.131082 Oct 20 13:40:58.269455 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 335/701] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:40:58 2022] DELETE /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:40:58.277885 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-6fda4d7d-a6a1-493e-a26f-9dcee0fdb53d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:58.278500 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-6fda4d7d-a6a1-493e-a26f-9dcee0fdb53d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:58.286569 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6fda4d7d-a6a1-493e-a26f-9dcee0fdb53d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:58.287300 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6fda4d7d-a6a1-493e-a26f-9dcee0fdb53d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:58.287923 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6fda4d7d-a6a1-493e-a26f-9dcee0fdb53d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:58.288822 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6fda4d7d-a6a1-493e-a26f-9dcee0fdb53d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:58.289574 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6fda4d7d-a6a1-493e-a26f-9dcee0fdb53d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:58.290511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-6fda4d7d-a6a1-493e-a26f-9dcee0fdb53d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:58.355311 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-105028464", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a87efad-1518-4319-8b6e-3edd28303f86"}], "security_groups": [{"name": "tempest-securitygroup--947360793"}], "key_name": "tempest-keypair-1081126730", "user_data": "}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:58.459829 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-6fda4d7d-a6a1-493e-a26f-9dcee0fdb53d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:58.469075 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-6fda4d7d-a6a1-493e-a26f-9dcee0fdb53d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1578 microversion: 2.1 time: 0.195309 Oct 20 13:40:58.469662 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 367/702] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:58 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1578 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:58.475413 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.network.neutron [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] validate_networks() for [('6a87efad-1518-4319-8b6e-3edd28303f86', None, None, None, None, None)] {{(pid=125448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:40:58.895322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Flavor limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:40:58.895790 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Image limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:40:58.896246 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Flavor pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:40:58.896656 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Image pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:40:58.897094 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:40:58.905880 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:58.906293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:58.906725 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:58.907445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:58.907893 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:58.908316 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:58.924733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for project b215cb88123a4851932dbf7dfa88f709. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:40:58.929310 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Getting quotas for user 144e9801ac1f470083d11647652ccdf1 and project b215cb88123a4851932dbf7dfa88f709. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:40:58.940137 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Going to run 1 instances... {{(pid=125448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:40:58.943142 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:40:58.986068 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3c7e2d7a-382c-4b2c-bf3a-982077ff7ae0 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:58.986680 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3c7e2d7a-382c-4b2c-bf3a-982077ff7ae0 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:58.989814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-02d13c07-ccdd-43d8-89b5-95a1e7b6f388 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.639331 Oct 20 13:40:58.997206 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 336/703] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:40:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 13:40:58.997387 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c7e2d7a-382c-4b2c-bf3a-982077ff7ae0 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:58.997387 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c7e2d7a-382c-4b2c-bf3a-982077ff7ae0 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:58.997387 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c7e2d7a-382c-4b2c-bf3a-982077ff7ae0 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:58.997387 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c7e2d7a-382c-4b2c-bf3a-982077ff7ae0 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:58.997725 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c7e2d7a-382c-4b2c-bf3a-982077ff7ae0 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:58.997725 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3c7e2d7a-382c-4b2c-bf3a-982077ff7ae0 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:59.002542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1cba2373-667b-4994-97e3-d174f4bb2aaa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:59.003964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1cba2373-667b-4994-97e3-d174f4bb2aaa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:59.064899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1cba2373-667b-4994-97e3-d174f4bb2aaa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:59.072486 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1cba2373-667b-4994-97e3-d174f4bb2aaa tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1241 microversion: 2.1 time: 0.073730 Oct 20 13:40:59.073650 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 337/704] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:58 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:59.143734 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3c7e2d7a-382c-4b2c-bf3a-982077ff7ae0 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:59.152403 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3c7e2d7a-382c-4b2c-bf3a-982077ff7ae0 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.170067 Oct 20 13:40:59.152990 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 368/705] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:58 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:40:59.494184 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7cd73583-1a55-4a77-9646-cd57d59ec3b1 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:40:59.495516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7cd73583-1a55-4a77-9646-cd57d59ec3b1 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:40:59.502717 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cd73583-1a55-4a77-9646-cd57d59ec3b1 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:59.503354 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cd73583-1a55-4a77-9646-cd57d59ec3b1 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:59.503930 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cd73583-1a55-4a77-9646-cd57d59ec3b1 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:59.504588 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cd73583-1a55-4a77-9646-cd57d59ec3b1 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:59.505434 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cd73583-1a55-4a77-9646-cd57d59ec3b1 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:59.506006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cd73583-1a55-4a77-9646-cd57d59ec3b1 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:59.520744 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [req-966986bb-4bb4-44d8-be6d-605ee896afc1 req-1b773969-246b-4c05-97fe-37aff19af128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89b72ca-c19d-4976-97be-086660601e2b", "name": "network-vif-plugged", "status": "completed", "tag": "57704c11-9966-4dc7-ba8b-0af092c2b73f"}]} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:40:59.531102 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-966986bb-4bb4-44d8-be6d-605ee896afc1 req-1b773969-246b-4c05-97fe-37aff19af128 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:40:59.531869 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-966986bb-4bb4-44d8-be6d-605ee896afc1 req-1b773969-246b-4c05-97fe-37aff19af128 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:40:59.532667 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [req-966986bb-4bb4-44d8-be6d-605ee896afc1 req-1b773969-246b-4c05-97fe-37aff19af128 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:40:59.546496 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.compute.server_external_events [req-966986bb-4bb4-44d8-be6d-605ee896afc1 req-1b773969-246b-4c05-97fe-37aff19af128 service nova] Creating event network-vif-plugged:57704c11-9966-4dc7-ba8b-0af092c2b73f for instance e89b72ca-c19d-4976-97be-086660601e2b on hv-cinder-86213 Oct 20 13:40:59.551713 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [req-966986bb-4bb4-44d8-be6d-605ee896afc1 req-1b773969-246b-4c05-97fe-37aff19af128 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035537 Oct 20 13:40:59.552437 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 369/706] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:40:59.662345 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7cd73583-1a55-4a77-9646-cd57d59ec3b1 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:40:59.670090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7cd73583-1a55-4a77-9646-cd57d59ec3b1 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1578 microversion: 2.1 time: 0.179809 Oct 20 13:40:59.670664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 338/707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:40:59 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:00.096584 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-4b504391-f5a4-40df-ba00-d3b232f6a954 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:00.098242 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-4b504391-f5a4-40df-ba00-d3b232f6a954 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:00.104365 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b504391-f5a4-40df-ba00-d3b232f6a954 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:00.104838 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b504391-f5a4-40df-ba00-d3b232f6a954 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:00.105302 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b504391-f5a4-40df-ba00-d3b232f6a954 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:00.105983 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b504391-f5a4-40df-ba00-d3b232f6a954 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:00.106440 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b504391-f5a4-40df-ba00-d3b232f6a954 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:00.106861 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-4b504391-f5a4-40df-ba00-d3b232f6a954 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:00.171003 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-4b504391-f5a4-40df-ba00-d3b232f6a954 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:00.174533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3177cb08-d86a-4d2b-8b11-768a70246a1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:00.175457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3177cb08-d86a-4d2b-8b11-768a70246a1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:00.178787 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-4b504391-f5a4-40df-ba00-d3b232f6a954 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1293 microversion: 2.1 time: 0.086948 Oct 20 13:41:00.179359 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 370/708] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:00 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:00.181752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3177cb08-d86a-4d2b-8b11-768a70246a1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:00.182233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3177cb08-d86a-4d2b-8b11-768a70246a1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:00.182664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3177cb08-d86a-4d2b-8b11-768a70246a1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:00.183354 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3177cb08-d86a-4d2b-8b11-768a70246a1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:00.183805 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3177cb08-d86a-4d2b-8b11-768a70246a1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:00.184222 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3177cb08-d86a-4d2b-8b11-768a70246a1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:00.364796 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3177cb08-d86a-4d2b-8b11-768a70246a1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:00.372813 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3177cb08-d86a-4d2b-8b11-768a70246a1e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1358 microversion: 2.1 time: 0.202306 Oct 20 13:41:00.373393 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 339/709] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:00 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:00.694709 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-09f19bd1-ff24-4e32-8962-00d6d826cce9 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:00.695325 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-09f19bd1-ff24-4e32-8962-00d6d826cce9 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:00.701240 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09f19bd1-ff24-4e32-8962-00d6d826cce9 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:00.701722 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09f19bd1-ff24-4e32-8962-00d6d826cce9 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:00.702155 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09f19bd1-ff24-4e32-8962-00d6d826cce9 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:00.702844 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09f19bd1-ff24-4e32-8962-00d6d826cce9 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:00.703303 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09f19bd1-ff24-4e32-8962-00d6d826cce9 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:00.703723 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-09f19bd1-ff24-4e32-8962-00d6d826cce9 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:00.837964 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-09f19bd1-ff24-4e32-8962-00d6d826cce9 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:00.846388 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-09f19bd1-ff24-4e32-8962-00d6d826cce9 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1578 microversion: 2.1 time: 0.155863 Oct 20 13:41:00.847829 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 371/710] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:00 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:01.126065 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-2368fb13-0145-467a-a9fa-9a62a6573b2a req-26b47476-9eee-46cb-a7db-30e9a2fa5f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a95c3c3-dcce-457b-98df-7b6ff3df8680", "name": "network-vif-deleted", "tag": "819ed6f1-641c-46ab-baf3-306b4b54da88"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:01.131752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:01.137752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2368fb13-0145-467a-a9fa-9a62a6573b2a req-26b47476-9eee-46cb-a7db-30e9a2fa5f03 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.138225 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2368fb13-0145-467a-a9fa-9a62a6573b2a req-26b47476-9eee-46cb-a7db-30e9a2fa5f03 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.138649 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2368fb13-0145-467a-a9fa-9a62a6573b2a req-26b47476-9eee-46cb-a7db-30e9a2fa5f03 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.153634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-2368fb13-0145-467a-a9fa-9a62a6573b2a req-26b47476-9eee-46cb-a7db-30e9a2fa5f03 service nova] Creating event network-vif-deleted:819ed6f1-641c-46ab-baf3-306b4b54da88 for instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 on hv-cinder-86213 Oct 20 13:41:01.158536 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-2368fb13-0145-467a-a9fa-9a62a6573b2a req-26b47476-9eee-46cb-a7db-30e9a2fa5f03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036236 Oct 20 13:41:01.159181 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 340/711] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:01.203530 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-dfdef59a-5d68-448e-a63e-82b7cb9097a0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:01.204480 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-dfdef59a-5d68-448e-a63e-82b7cb9097a0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:01.212025 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dfdef59a-5d68-448e-a63e-82b7cb9097a0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.212856 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dfdef59a-5d68-448e-a63e-82b7cb9097a0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.213424 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dfdef59a-5d68-448e-a63e-82b7cb9097a0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.214284 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dfdef59a-5d68-448e-a63e-82b7cb9097a0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.214845 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dfdef59a-5d68-448e-a63e-82b7cb9097a0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.215397 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-dfdef59a-5d68-448e-a63e-82b7cb9097a0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.285951 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-dfdef59a-5d68-448e-a63e-82b7cb9097a0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:01.294286 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-dfdef59a-5d68-448e-a63e-82b7cb9097a0 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1293 microversion: 2.1 time: 0.094528 Oct 20 13:41:01.295051 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 372/712] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:01 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:01.399338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-693dfc1f-0734-47b8-9933-b8a4b6996b33 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:01.400694 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-693dfc1f-0734-47b8-9933-b8a4b6996b33 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:01.415022 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-693dfc1f-0734-47b8-9933-b8a4b6996b33 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.415967 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-693dfc1f-0734-47b8-9933-b8a4b6996b33 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.416695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-693dfc1f-0734-47b8-9933-b8a4b6996b33 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.418082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-693dfc1f-0734-47b8-9933-b8a4b6996b33 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.418700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-693dfc1f-0734-47b8-9933-b8a4b6996b33 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.419325 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-693dfc1f-0734-47b8-9933-b8a4b6996b33 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.561866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-693dfc1f-0734-47b8-9933-b8a4b6996b33 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:01.570303 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-693dfc1f-0734-47b8-9933-b8a4b6996b33 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1547 microversion: 2.1 time: 0.178428 Oct 20 13:41:01.570876 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 341/713] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:01 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1547 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:01.592638 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-0f187a27-ff2f-4d9d-91e7-7d54e0459282 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:01.593275 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-0f187a27-ff2f-4d9d-91e7-7d54e0459282 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:01.599592 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f187a27-ff2f-4d9d-91e7-7d54e0459282 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.600154 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f187a27-ff2f-4d9d-91e7-7d54e0459282 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.600661 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f187a27-ff2f-4d9d-91e7-7d54e0459282 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.601469 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f187a27-ff2f-4d9d-91e7-7d54e0459282 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.601980 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f187a27-ff2f-4d9d-91e7-7d54e0459282 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.602520 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-0f187a27-ff2f-4d9d-91e7-7d54e0459282 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.736746 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-0f187a27-ff2f-4d9d-91e7-7d54e0459282 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:01.744801 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-0f187a27-ff2f-4d9d-91e7-7d54e0459282 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1547 microversion: 2.1 time: 0.155945 Oct 20 13:41:01.745516 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 373/714] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:01 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:01.766620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:01.772058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:01.772825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Searching by: {'deleted': False, 'project_id': 'accdb851c01342d49228faa016ff430c'} {{(pid=125448) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 20 13:41:01.779352 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.779827 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.780255 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.781001 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.781451 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.781870 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.853153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:01.873501 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-3850cd97-d50a-4f9e-a87c-301d54d2e9e2 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:01.874210 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-3850cd97-d50a-4f9e-a87c-301d54d2e9e2 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:01.876150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.multi_cell_list [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125448) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 20 13:41:01.880931 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3850cd97-d50a-4f9e-a87c-301d54d2e9e2 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.881731 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3850cd97-d50a-4f9e-a87c-301d54d2e9e2 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.882372 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3850cd97-d50a-4f9e-a87c-301d54d2e9e2 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.883269 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3850cd97-d50a-4f9e-a87c-301d54d2e9e2 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:01.883845 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3850cd97-d50a-4f9e-a87c-301d54d2e9e2 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:01.884339 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-3850cd97-d50a-4f9e-a87c-301d54d2e9e2 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:01.991146 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-bd0968ec-aebf-45df-b5ac-bccdc77b9a1b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.228069 Oct 20 13:41:01.997083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 342/715] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 20 13:41:01 2022] GET /compute/v2.1/servers => generated 342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:02.008327 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-69e3e6e5-bf7e-44f0-9dde-712ddcb65652 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:02.009793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-69e3e6e5-bf7e-44f0-9dde-712ddcb65652 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:02.016374 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-3850cd97-d50a-4f9e-a87c-301d54d2e9e2 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac26a28e7b416b9786ddcacea5928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ef0737a3844bfe8f4bc14b09ebc88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:02.017913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e3e6e5-bf7e-44f0-9dde-712ddcb65652 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:02.018672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e3e6e5-bf7e-44f0-9dde-712ddcb65652 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:02.019696 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e3e6e5-bf7e-44f0-9dde-712ddcb65652 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:02.020095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e3e6e5-bf7e-44f0-9dde-712ddcb65652 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:02.020617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e3e6e5-bf7e-44f0-9dde-712ddcb65652 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:02.021383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e3e6e5-bf7e-44f0-9dde-712ddcb65652 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:02.027496 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-3850cd97-d50a-4f9e-a87c-301d54d2e9e2 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 200 len: 1226 microversion: 2.1 time: 0.158207 Oct 20 13:41:02.041215 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 374/716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:01 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 1226 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:02.257160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-69e3e6e5-bf7e-44f0-9dde-712ddcb65652 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:02.270683 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-69e3e6e5-bf7e-44f0-9dde-712ddcb65652 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1547 microversion: 2.1 time: 0.270525 Oct 20 13:41:02.271298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 343/717] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:01 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1547 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:02.320629 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-b4a92805-8ab6-4487-9815-4e8b0101cae2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:02.321432 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.compute.api [None req-b4a92805-8ab6-4487-9815-4e8b0101cae2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125447) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:02.328181 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4a92805-8ab6-4487-9815-4e8b0101cae2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:02.328675 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4a92805-8ab6-4487-9815-4e8b0101cae2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:02.329149 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4a92805-8ab6-4487-9815-4e8b0101cae2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:02.333418 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4a92805-8ab6-4487-9815-4e8b0101cae2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:02.333942 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4a92805-8ab6-4487-9815-4e8b0101cae2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:02.334388 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG oslo_concurrency.lockutils [None req-b4a92805-8ab6-4487-9815-4e8b0101cae2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:02.409758 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.policy [None req-b4a92805-8ab6-4487-9815-4e8b0101cae2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125447) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:02.419610 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO nova.api.openstack.requestlog [None req-b4a92805-8ab6-4487-9815-4e8b0101cae2 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1299 microversion: 2.1 time: 0.105429 Oct 20 13:41:02.425434 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: [pid: 125447|app: 0|req: 375/718] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:02 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:03.056895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:03.057766 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:03.066571 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:03.067302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:03.067913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:03.068767 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:03.069420 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:03.069992 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:03.088847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] HTTP exception thrown: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Request method failure captured: Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 HTTP/1.1 Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU8cDuTEvrUkYLHTssq9B7DyI31ydZnts91BrczOyc3C46vtoU3jA4gzdFiFnioizWeBXxNen4fsaEflvzzFhr75E2FV8fdePHz0Lxnwf5xcR_4-Y0E-owjBaFOAXhrfNb2Q0csTyhWafKT1-fvjI6orc2LbjfPz2McyEQuiUsuDLn0 Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 32ef0737a3844bfe8f4bc14b09ebc88b Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-TestVolumeBootPattern-1820889015 Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:41:03.090663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-TestVolumeBootPattern-1820889015 Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 32ef0737a3844bfe8f4bc14b09ebc88b Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-TestVolumeBootPattern-1820889015 Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-TestVolumeBootPattern-1820889015-project Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: c9ac26a28e7b416b9786ddcacea5928e Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-TestVolumeBootPattern-1820889015-project Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:41:03.091957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '3a95c3c3-dcce-457b-98df-7b6ff3df8680'} Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:41:03.092733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:41:03.094868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:03.095946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Returning 404 to user: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:41:03.095946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fabd0270-7daa-4f36-9b33-252538f00f84 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 404 len: 111 microversion: 2.1 time: 0.043438 Oct 20 13:41:03.095946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 344/719] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:03 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:41:03.207513 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG nova.api.openstack.wsgi [None req-f85fd738-89a1-4e58-bbed-f47aadbd903d tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-430423018", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1334420547", "security_groups": [{"name": "tempest-secgroup-smoke-1530929524"}], "block_device_mapping_v2": [{"uuid": "4b2d5a16-ef1e-4a76-8e54-f5293ab87ade", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2d938c2-510e-4c09-96e0-662b0c7b6d79"}]}} {{(pid=125447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:03.445270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-42fe60c8-fa8b-49b2-86ff-8485c092afd6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:03.446077 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-42fe60c8-fa8b-49b2-86ff-8485c092afd6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:03.452448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42fe60c8-fa8b-49b2-86ff-8485c092afd6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:03.453463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42fe60c8-fa8b-49b2-86ff-8485c092afd6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:03.453904 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42fe60c8-fa8b-49b2-86ff-8485c092afd6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:03.454647 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42fe60c8-fa8b-49b2-86ff-8485c092afd6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:03.455095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42fe60c8-fa8b-49b2-86ff-8485c092afd6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:03.455516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42fe60c8-fa8b-49b2-86ff-8485c092afd6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:03.678037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-42fe60c8-fa8b-49b2-86ff-8485c092afd6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:03.685691 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-42fe60c8-fa8b-49b2-86ff-8485c092afd6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1366 microversion: 2.1 time: 0.244179 Oct 20 13:41:03.687436 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 345/720] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:03 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:03.888707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-97c7c4e9-9dd8-4499-8094-37c86168ae19 req-b96ddeac-9593-4207-8571-be32975ed050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09046678-4ab5-4b0a-af64-386fcb5735c5", "tag": "56c0f2ff-4b2b-47e3-8bfd-ca7966abf40e"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:03.901027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-97c7c4e9-9dd8-4499-8094-37c86168ae19 req-b96ddeac-9593-4207-8571-be32975ed050 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:03.901676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-97c7c4e9-9dd8-4499-8094-37c86168ae19 req-b96ddeac-9593-4207-8571-be32975ed050 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:03.902103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-97c7c4e9-9dd8-4499-8094-37c86168ae19 req-b96ddeac-9593-4207-8571-be32975ed050 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:03.915228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-97c7c4e9-9dd8-4499-8094-37c86168ae19 req-b96ddeac-9593-4207-8571-be32975ed050 service nova] Creating event network-changed:56c0f2ff-4b2b-47e3-8bfd-ca7966abf40e for instance 09046678-4ab5-4b0a-af64-386fcb5735c5 on hv-cinder-86213 Oct 20 13:41:03.920242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-97c7c4e9-9dd8-4499-8094-37c86168ae19 req-b96ddeac-9593-4207-8571-be32975ed050 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035857 Oct 20 13:41:03.921609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 346/721] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:03.927261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a25153c3-952e-489f-a7a4-3b80236bcdad tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3db165f-4afb-442c-91f8-f481cc438d4d"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:03.929683 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a25153c3-952e-489f-a7a4-3b80236bcdad tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:03.936243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a25153c3-952e-489f-a7a4-3b80236bcdad tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:03.936723 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a25153c3-952e-489f-a7a4-3b80236bcdad tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:03.937186 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a25153c3-952e-489f-a7a4-3b80236bcdad tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:03.937881 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a25153c3-952e-489f-a7a4-3b80236bcdad tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:03.938323 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a25153c3-952e-489f-a7a4-3b80236bcdad tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:03.938769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a25153c3-952e-489f-a7a4-3b80236bcdad tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:04.192825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a25153c3-952e-489f-a7a4-3b80236bcdad tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "POST /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269676 Oct 20 13:41:04.199100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 347/722] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:41:03 2022] POST /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:04.709905 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7694c910-a042-4c49-9911-f1354972e8b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:04.710640 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7694c910-a042-4c49-9911-f1354972e8b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:04.716754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7694c910-a042-4c49-9911-f1354972e8b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:04.717270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7694c910-a042-4c49-9911-f1354972e8b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:04.717706 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7694c910-a042-4c49-9911-f1354972e8b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:04.718388 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7694c910-a042-4c49-9911-f1354972e8b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:04.718838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7694c910-a042-4c49-9911-f1354972e8b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:04.719293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7694c910-a042-4c49-9911-f1354972e8b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:04.850118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7694c910-a042-4c49-9911-f1354972e8b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:04.857683 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7694c910-a042-4c49-9911-f1354972e8b9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1366 microversion: 2.1 time: 0.152566 Oct 20 13:41:04.858243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 348/723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:04 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:05.882095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-20a52c4d-9d5b-4cc8-b409-db448a0630ae tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:05.882719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-20a52c4d-9d5b-4cc8-b409-db448a0630ae tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:05.889087 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a52c4d-9d5b-4cc8-b409-db448a0630ae tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:05.889561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a52c4d-9d5b-4cc8-b409-db448a0630ae tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:05.889990 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a52c4d-9d5b-4cc8-b409-db448a0630ae tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:05.890663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a52c4d-9d5b-4cc8-b409-db448a0630ae tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:05.891107 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a52c4d-9d5b-4cc8-b409-db448a0630ae tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:05.891526 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20a52c4d-9d5b-4cc8-b409-db448a0630ae tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:06.017910 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-20a52c4d-9d5b-4cc8-b409-db448a0630ae tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:06.025541 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-20a52c4d-9d5b-4cc8-b409-db448a0630ae tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1366 microversion: 2.1 time: 0.147942 Oct 20 13:41:06.026109 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 349/724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:05 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:07.049010 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fa91ab97-fe69-4faa-b41b-11d53d225c28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:07.049806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fa91ab97-fe69-4faa-b41b-11d53d225c28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:07.055989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa91ab97-fe69-4faa-b41b-11d53d225c28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:07.056470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa91ab97-fe69-4faa-b41b-11d53d225c28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:07.056928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa91ab97-fe69-4faa-b41b-11d53d225c28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:07.057615 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa91ab97-fe69-4faa-b41b-11d53d225c28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:07.058067 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa91ab97-fe69-4faa-b41b-11d53d225c28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:07.058492 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa91ab97-fe69-4faa-b41b-11d53d225c28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:07.185224 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fa91ab97-fe69-4faa-b41b-11d53d225c28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:07.193924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fa91ab97-fe69-4faa-b41b-11d53d225c28 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1366 microversion: 2.1 time: 0.148804 Oct 20 13:41:07.194502 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 350/725] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:07 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:08.216619 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-295acd8d-8f80-47b1-bce5-8cc016195a7d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:08.217267 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-295acd8d-8f80-47b1-bce5-8cc016195a7d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:08.223630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-295acd8d-8f80-47b1-bce5-8cc016195a7d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:08.224110 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-295acd8d-8f80-47b1-bce5-8cc016195a7d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:08.224545 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-295acd8d-8f80-47b1-bce5-8cc016195a7d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:08.225269 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-295acd8d-8f80-47b1-bce5-8cc016195a7d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:08.225718 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-295acd8d-8f80-47b1-bce5-8cc016195a7d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:08.226138 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-295acd8d-8f80-47b1-bce5-8cc016195a7d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:08.355490 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-295acd8d-8f80-47b1-bce5-8cc016195a7d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:08.363528 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-295acd8d-8f80-47b1-bce5-8cc016195a7d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1366 microversion: 2.1 time: 0.150734 Oct 20 13:41:08.364086 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 351/726] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:08 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:09.069367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=12 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:09.131883 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-69082b65-9d1d-4ea6-aac0-3f93689e48f9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:09.132373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-69082b65-9d1d-4ea6-aac0-3f93689e48f9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:09.138266 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69082b65-9d1d-4ea6-aac0-3f93689e48f9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:09.138747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69082b65-9d1d-4ea6-aac0-3f93689e48f9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:09.139174 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69082b65-9d1d-4ea6-aac0-3f93689e48f9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:09.139854 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69082b65-9d1d-4ea6-aac0-3f93689e48f9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:09.140301 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69082b65-9d1d-4ea6-aac0-3f93689e48f9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:09.140715 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69082b65-9d1d-4ea6-aac0-3f93689e48f9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:09.163100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-69082b65-9d1d-4ea6-aac0-3f93689e48f9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/ips" status: 200 len: 144 microversion: 2.1 time: 0.132363 Oct 20 13:41:09.163640 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 352/727] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 20 13:41:09 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/ips => generated 144 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:09.386577 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1522ad4d-8c4f-46e6-a59e-06d520ff1d5c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:09.387952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1522ad4d-8c4f-46e6-a59e-06d520ff1d5c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:09.400017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1522ad4d-8c4f-46e6-a59e-06d520ff1d5c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:09.400771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1522ad4d-8c4f-46e6-a59e-06d520ff1d5c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:09.401356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1522ad4d-8c4f-46e6-a59e-06d520ff1d5c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:09.402131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1522ad4d-8c4f-46e6-a59e-06d520ff1d5c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:09.402648 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1522ad4d-8c4f-46e6-a59e-06d520ff1d5c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:09.403283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1522ad4d-8c4f-46e6-a59e-06d520ff1d5c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:09.565037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1522ad4d-8c4f-46e6-a59e-06d520ff1d5c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:09.574389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1522ad4d-8c4f-46e6-a59e-06d520ff1d5c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1366 microversion: 2.1 time: 0.191654 Oct 20 13:41:09.574959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 353/728] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:09 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:09.681221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d08b17b7-daa4-4122-82fb-aa185f186c51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:09.681715 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d08b17b7-daa4-4122-82fb-aa185f186c51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:09.687538 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d08b17b7-daa4-4122-82fb-aa185f186c51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:09.688019 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d08b17b7-daa4-4122-82fb-aa185f186c51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:09.688443 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d08b17b7-daa4-4122-82fb-aa185f186c51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:09.689138 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d08b17b7-daa4-4122-82fb-aa185f186c51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:09.689579 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d08b17b7-daa4-4122-82fb-aa185f186c51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:09.689993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d08b17b7-daa4-4122-82fb-aa185f186c51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:09.714878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d08b17b7-daa4-4122-82fb-aa185f186c51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/ips" status: 200 len: 151 microversion: 2.20 time: 0.138918 Oct 20 13:41:09.715431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 354/729] 10.222.0.23 () {60 vars in 1289 bytes} [Thu Oct 20 13:41:09 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/ips => generated 151 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:41:09.719638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-95d279f0-3f53-4eb4-852b-91ed11552603 req-50e246e4-ac90-41dc-82b6-466b205bdba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09046678-4ab5-4b0a-af64-386fcb5735c5", "name": "network-vif-plugged", "status": "completed", "tag": "56c0f2ff-4b2b-47e3-8bfd-ca7966abf40e"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:09.729281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-95d279f0-3f53-4eb4-852b-91ed11552603 req-50e246e4-ac90-41dc-82b6-466b205bdba4 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:09.729748 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-95d279f0-3f53-4eb4-852b-91ed11552603 req-50e246e4-ac90-41dc-82b6-466b205bdba4 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:09.730277 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-95d279f0-3f53-4eb4-852b-91ed11552603 req-50e246e4-ac90-41dc-82b6-466b205bdba4 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:09.741530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-95d279f0-3f53-4eb4-852b-91ed11552603 req-50e246e4-ac90-41dc-82b6-466b205bdba4 service nova] Creating event network-vif-plugged:56c0f2ff-4b2b-47e3-8bfd-ca7966abf40e for instance 09046678-4ab5-4b0a-af64-386fcb5735c5 on hv-cinder-86213 Oct 20 13:41:09.746604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-95d279f0-3f53-4eb4-852b-91ed11552603 req-50e246e4-ac90-41dc-82b6-466b205bdba4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030099 Oct 20 13:41:09.747258 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 355/730] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:10.530827 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e3dae0b2-66f4-4ba5-a3d0-5c3fe7b286ba tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d8e94e1-4045-4523-a776-b195ad8dd4b9"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:10.533298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e3dae0b2-66f4-4ba5-a3d0-5c3fe7b286ba tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:10.539555 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3dae0b2-66f4-4ba5-a3d0-5c3fe7b286ba tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:10.540042 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3dae0b2-66f4-4ba5-a3d0-5c3fe7b286ba tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:10.540451 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3dae0b2-66f4-4ba5-a3d0-5c3fe7b286ba tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:10.541517 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3dae0b2-66f4-4ba5-a3d0-5c3fe7b286ba tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:10.541965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3dae0b2-66f4-4ba5-a3d0-5c3fe7b286ba tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:10.542387 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e3dae0b2-66f4-4ba5-a3d0-5c3fe7b286ba tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:11.827797 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=4 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:11.908766 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e3dae0b2-66f4-4ba5-a3d0-5c3fe7b286ba tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.382457 Oct 20 13:41:11.909686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 356/731] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:41:10 2022] POST /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments => generated 194 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:11.914667 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9b6bab52-6562-4e2a-8a24-96e6c3a49e53 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:11.915370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9b6bab52-6562-4e2a-8a24-96e6c3a49e53 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:11.921360 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9b6bab52-6562-4e2a-8a24-96e6c3a49e53 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:11.921841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9b6bab52-6562-4e2a-8a24-96e6c3a49e53 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:11.922274 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9b6bab52-6562-4e2a-8a24-96e6c3a49e53 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:11.922954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9b6bab52-6562-4e2a-8a24-96e6c3a49e53 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:11.923400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9b6bab52-6562-4e2a-8a24-96e6c3a49e53 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:11.923819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9b6bab52-6562-4e2a-8a24-96e6c3a49e53 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:12.051996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9b6bab52-6562-4e2a-8a24-96e6c3a49e53 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:12.060145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9b6bab52-6562-4e2a-8a24-96e6c3a49e53 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1555 microversion: 2.1 time: 0.149324 Oct 20 13:41:12.060645 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 357/732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:11 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:12.065127 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f48597c3-6049-49b9-bcfd-cd05dd3dcfa6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:12.065652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f48597c3-6049-49b9-bcfd-cd05dd3dcfa6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:12.071649 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f48597c3-6049-49b9-bcfd-cd05dd3dcfa6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:12.072133 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f48597c3-6049-49b9-bcfd-cd05dd3dcfa6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:12.072572 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f48597c3-6049-49b9-bcfd-cd05dd3dcfa6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:12.073284 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f48597c3-6049-49b9-bcfd-cd05dd3dcfa6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:12.073736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f48597c3-6049-49b9-bcfd-cd05dd3dcfa6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:12.074159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f48597c3-6049-49b9-bcfd-cd05dd3dcfa6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:12.091241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:12.098570 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-f48597c3-6049-49b9-bcfd-cd05dd3dcfa6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lazy-loading 'flavor' on Instance uuid c34aa5d9-ed42-4cdd-bed0-229455d27cf1 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:12.297863 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f48597c3-6049-49b9-bcfd-cd05dd3dcfa6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "POST /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/action" status: 202 len: 0 microversion: 2.20 time: 0.235310 Oct 20 13:41:12.304309 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 358/733] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 20 13:41:12 2022] POST /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:41:12.311501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c686f5a3-165f-4a63-9709-5847d0a9a8e8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:12.311985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c686f5a3-165f-4a63-9709-5847d0a9a8e8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:12.324379 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c686f5a3-165f-4a63-9709-5847d0a9a8e8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:12.325003 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c686f5a3-165f-4a63-9709-5847d0a9a8e8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:12.325470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c686f5a3-165f-4a63-9709-5847d0a9a8e8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:12.326179 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c686f5a3-165f-4a63-9709-5847d0a9a8e8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:12.326719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c686f5a3-165f-4a63-9709-5847d0a9a8e8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:12.327289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c686f5a3-165f-4a63-9709-5847d0a9a8e8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:12.412767 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c686f5a3-165f-4a63-9709-5847d0a9a8e8 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106512 Oct 20 13:41:12.413471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 359/734] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 20 13:41:12 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:12.415054 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_cell1:SELECT=54 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:12.418539 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:12.419220 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:12.425180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:12.425730 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:12.426219 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:12.426852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:12.427293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:12.427706 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:12.563950 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:12.572977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:12.574610 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:12.575899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2669cb22-1efa-4dd6-a4bd-311591ae2b11 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1722 microversion: 2.20 time: 0.161286 Oct 20 13:41:12.576557 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 360/735] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:12 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:12.878028 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-42aca733-2434-41c7-92c7-bc7691e412c6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:12.879941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-42aca733-2434-41c7-92c7-bc7691e412c6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:12.886957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42aca733-2434-41c7-92c7-bc7691e412c6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:12.887556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42aca733-2434-41c7-92c7-bc7691e412c6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:12.888051 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42aca733-2434-41c7-92c7-bc7691e412c6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:12.888814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42aca733-2434-41c7-92c7-bc7691e412c6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:12.889368 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42aca733-2434-41c7-92c7-bc7691e412c6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:12.889854 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42aca733-2434-41c7-92c7-bc7691e412c6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:13.029871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-42aca733-2434-41c7-92c7-bc7691e412c6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:13.038483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-42aca733-2434-41c7-92c7-bc7691e412c6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1593 microversion: 2.1 time: 0.164339 Oct 20 13:41:13.039313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 361/736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:12 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1593 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:13.221212 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: DEBUG dbcounter [-] [125447] Writing DB stats nova_api:SELECT=31 {{(pid=125447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:13.661730 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-b223710d-d34f-406d-8f6a-aee1b78cc9e4 req-1df37e1c-a3d5-408c-bbd4-ac008f7fbe12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09046678-4ab5-4b0a-af64-386fcb5735c5", "tag": "56c0f2ff-4b2b-47e3-8bfd-ca7966abf40e"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:13.671348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-b223710d-d34f-406d-8f6a-aee1b78cc9e4 req-1df37e1c-a3d5-408c-bbd4-ac008f7fbe12 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:13.671822 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-b223710d-d34f-406d-8f6a-aee1b78cc9e4 req-1df37e1c-a3d5-408c-bbd4-ac008f7fbe12 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:13.672238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-b223710d-d34f-406d-8f6a-aee1b78cc9e4 req-1df37e1c-a3d5-408c-bbd4-ac008f7fbe12 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:13.684468 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-b223710d-d34f-406d-8f6a-aee1b78cc9e4 req-1df37e1c-a3d5-408c-bbd4-ac008f7fbe12 service nova] Creating event network-changed:56c0f2ff-4b2b-47e3-8bfd-ca7966abf40e for instance 09046678-4ab5-4b0a-af64-386fcb5735c5 on hv-cinder-86213 Oct 20 13:41:13.690442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-b223710d-d34f-406d-8f6a-aee1b78cc9e4 req-1df37e1c-a3d5-408c-bbd4-ac008f7fbe12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120397 Oct 20 13:41:13.691217 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 362/737] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:13.696318 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:13.697101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:13.703964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:13.704450 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:13.705082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:13.705958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:13.707081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:13.707658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:14.029441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:14.038734 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:14.040270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:14.044203 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cccc88f4-cc98-427c-bdb8-f821b2cb6b12 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1722 microversion: 2.20 time: 0.349379 Oct 20 13:41:14.057687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 363/738] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:13 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:14.485164 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a120746e-8f46-4518-be1d-188844b9050d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:14.485907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a120746e-8f46-4518-be1d-188844b9050d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:14.493385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a120746e-8f46-4518-be1d-188844b9050d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:14.494442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a120746e-8f46-4518-be1d-188844b9050d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:14.495772 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a120746e-8f46-4518-be1d-188844b9050d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:14.496632 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a120746e-8f46-4518-be1d-188844b9050d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:14.497253 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a120746e-8f46-4518-be1d-188844b9050d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:14.497818 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a120746e-8f46-4518-be1d-188844b9050d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:14.591604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-a120746e-8f46-4518-be1d-188844b9050d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lazy-loading 'services' on Instance uuid 5f326ad5-ca2f-4300-8676-2b6d7edfb108 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:14.682390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a120746e-8f46-4518-be1d-188844b9050d tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments/b0bf67ff-710d-4558-8467-6a869ea6d959" status: 202 len: 0 microversion: 2.1 time: 0.201998 Oct 20 13:41:14.682982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 364/739] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:41:14 2022] DELETE /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments/b0bf67ff-710d-4558-8467-6a869ea6d959 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 13:41:14.692900 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-42451f06-07d2-4df1-9189-47dd0a1d0ceb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:14.695946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-42451f06-07d2-4df1-9189-47dd0a1d0ceb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:14.703618 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42451f06-07d2-4df1-9189-47dd0a1d0ceb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:14.704085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42451f06-07d2-4df1-9189-47dd0a1d0ceb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:14.704516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42451f06-07d2-4df1-9189-47dd0a1d0ceb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:14.705284 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42451f06-07d2-4df1-9189-47dd0a1d0ceb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:14.705733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42451f06-07d2-4df1-9189-47dd0a1d0ceb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:14.706155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42451f06-07d2-4df1-9189-47dd0a1d0ceb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:14.740618 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-42451f06-07d2-4df1-9189-47dd0a1d0ceb tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052977 Oct 20 13:41:14.741249 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 365/740] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:41:14 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:15.070852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:15.071621 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:15.077995 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:15.078471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:15.078899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:15.079587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:15.080029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:15.080442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:15.298974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:15.307046 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:15.308464 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:15.309696 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d32bfb91-0394-4d55-ba84-99f8ca88b61d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1722 microversion: 2.20 time: 0.242777 Oct 20 13:41:15.310252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 366/741] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:15 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:15.536601 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-cc102d84-44e4-47e5-9be9-d29d3cb45a39 req-6772b129-c8b4-4f8c-968b-4b3b083f1666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89b72ca-c19d-4976-97be-086660601e2b", "tag": "57704c11-9966-4dc7-ba8b-0af092c2b73f"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:15.546541 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-cc102d84-44e4-47e5-9be9-d29d3cb45a39 req-6772b129-c8b4-4f8c-968b-4b3b083f1666 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:15.547788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-cc102d84-44e4-47e5-9be9-d29d3cb45a39 req-6772b129-c8b4-4f8c-968b-4b3b083f1666 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:15.548363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-cc102d84-44e4-47e5-9be9-d29d3cb45a39 req-6772b129-c8b4-4f8c-968b-4b3b083f1666 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:15.563143 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-cc102d84-44e4-47e5-9be9-d29d3cb45a39 req-6772b129-c8b4-4f8c-968b-4b3b083f1666 service nova] Creating event network-changed:57704c11-9966-4dc7-ba8b-0af092c2b73f for instance e89b72ca-c19d-4976-97be-086660601e2b on hv-cinder-86213 Oct 20 13:41:15.569057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-cc102d84-44e4-47e5-9be9-d29d3cb45a39 req-6772b129-c8b4-4f8c-968b-4b3b083f1666 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105174 Oct 20 13:41:15.569746 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 367/742] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:15.756322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a8d5f60f-9d15-4b7a-a48e-69c82a803017 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:15.758700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a8d5f60f-9d15-4b7a-a48e-69c82a803017 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:15.765412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8d5f60f-9d15-4b7a-a48e-69c82a803017 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:15.766224 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8d5f60f-9d15-4b7a-a48e-69c82a803017 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:15.766714 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8d5f60f-9d15-4b7a-a48e-69c82a803017 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:15.767507 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8d5f60f-9d15-4b7a-a48e-69c82a803017 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:15.768023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8d5f60f-9d15-4b7a-a48e-69c82a803017 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:15.768519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a8d5f60f-9d15-4b7a-a48e-69c82a803017 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:15.826781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a8d5f60f-9d15-4b7a-a48e-69c82a803017 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076380 Oct 20 13:41:15.832936 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 368/743] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:41:15 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:16.336465 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:16.337699 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:16.346027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:16.347474 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:16.348104 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:16.349171 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:16.349629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:16.350038 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:16.502475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:16.522411 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:16.523843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:16.529634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-40b9e19d-abbf-4390-b8ba-1c43790d1f57 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1722 microversion: 2.20 time: 0.198675 Oct 20 13:41:16.540945 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 369/744] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:16 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:16.542295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-98d59c0e-98e4-45e4-998c-0fb0f55e6b3c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1619157036"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:16.542830 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-98d59c0e-98e4-45e4-998c-0fb0f55e6b3c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:16.548850 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98d59c0e-98e4-45e4-998c-0fb0f55e6b3c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:16.549440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98d59c0e-98e4-45e4-998c-0fb0f55e6b3c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:16.549890 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98d59c0e-98e4-45e4-998c-0fb0f55e6b3c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:16.550775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98d59c0e-98e4-45e4-998c-0fb0f55e6b3c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:16.551241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98d59c0e-98e4-45e4-998c-0fb0f55e6b3c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:16.551666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98d59c0e-98e4-45e4-998c-0fb0f55e6b3c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:16.687586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.network.security_group_api [None req-98d59c0e-98e4-45e4-998c-0fb0f55e6b3c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Adding security group 5478a9d8-2f05-4d92-8662-da8f5dbdb472 to port 57704c11-9966-4dc7-ba8b-0af092c2b73f Oct 20 13:41:17.001866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-98d59c0e-98e4-45e4-998c-0fb0f55e6b3c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "POST /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/action" status: 202 len: 0 microversion: 2.1 time: 0.463567 Oct 20 13:41:17.002607 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 370/745] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:41:16 2022] POST /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:41:17.007689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-de989966-33e3-4bff-83e6-d1cd2fde728f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:17.010970 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-de989966-33e3-4bff-83e6-d1cd2fde728f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:17.017037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de989966-33e3-4bff-83e6-d1cd2fde728f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:17.017607 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de989966-33e3-4bff-83e6-d1cd2fde728f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:17.018121 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de989966-33e3-4bff-83e6-d1cd2fde728f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:17.019027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de989966-33e3-4bff-83e6-d1cd2fde728f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:17.019639 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de989966-33e3-4bff-83e6-d1cd2fde728f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:17.020267 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de989966-33e3-4bff-83e6-d1cd2fde728f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:17.052695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-de989966-33e3-4bff-83e6-d1cd2fde728f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048774 Oct 20 13:41:17.053318 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 371/746] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:41:17 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:17.057811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-84614180-4ee0-47f5-b53f-e3eb6428de50 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:17.058490 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-84614180-4ee0-47f5-b53f-e3eb6428de50 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:17.064405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84614180-4ee0-47f5-b53f-e3eb6428de50 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:17.064906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84614180-4ee0-47f5-b53f-e3eb6428de50 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:17.065334 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84614180-4ee0-47f5-b53f-e3eb6428de50 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:17.066226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84614180-4ee0-47f5-b53f-e3eb6428de50 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:17.066671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84614180-4ee0-47f5-b53f-e3eb6428de50 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:17.067083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-84614180-4ee0-47f5-b53f-e3eb6428de50 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:17.212775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-84614180-4ee0-47f5-b53f-e3eb6428de50 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:17.220966 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-84614180-4ee0-47f5-b53f-e3eb6428de50 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1758 microversion: 2.1 time: 0.166671 Oct 20 13:41:17.221535 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 372/747] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:17 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:17.556279 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:17.556954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:17.563257 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:17.563738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:17.564169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:17.564935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:17.565389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:17.565944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:17.694953 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:17.702937 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:17.704381 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:17.705553 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f351dd9d-2df5-474e-a053-3cd4868e6811 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1722 microversion: 2.20 time: 0.153248 Oct 20 13:41:17.706112 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 373/748] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:17 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:17.710974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-f091d66d-5e82-4d12-8a2d-09aad376176f req-a022366d-91e7-4e29-bc63-93e1edbc5625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89b72ca-c19d-4976-97be-086660601e2b", "tag": "57704c11-9966-4dc7-ba8b-0af092c2b73f"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:17.719893 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f091d66d-5e82-4d12-8a2d-09aad376176f req-a022366d-91e7-4e29-bc63-93e1edbc5625 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:17.720359 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f091d66d-5e82-4d12-8a2d-09aad376176f req-a022366d-91e7-4e29-bc63-93e1edbc5625 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:17.720782 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f091d66d-5e82-4d12-8a2d-09aad376176f req-a022366d-91e7-4e29-bc63-93e1edbc5625 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:17.731952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-f091d66d-5e82-4d12-8a2d-09aad376176f req-a022366d-91e7-4e29-bc63-93e1edbc5625 service nova] Creating event network-changed:57704c11-9966-4dc7-ba8b-0af092c2b73f for instance e89b72ca-c19d-4976-97be-086660601e2b on hv-cinder-86213 Oct 20 13:41:17.736636 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-f091d66d-5e82-4d12-8a2d-09aad376176f req-a022366d-91e7-4e29-bc63-93e1edbc5625 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028878 Oct 20 13:41:17.737242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 374/749] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:18.065883 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a5cdd878-1e01-466c-ac45-1528b77fad43 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:18.068195 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a5cdd878-1e01-466c-ac45-1528b77fad43 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:18.074338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5cdd878-1e01-466c-ac45-1528b77fad43 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:18.074817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5cdd878-1e01-466c-ac45-1528b77fad43 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:18.075248 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5cdd878-1e01-466c-ac45-1528b77fad43 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:18.075930 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5cdd878-1e01-466c-ac45-1528b77fad43 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:18.076385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5cdd878-1e01-466c-ac45-1528b77fad43 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:18.076809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a5cdd878-1e01-466c-ac45-1528b77fad43 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:18.080558 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:18.108390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a5cdd878-1e01-466c-ac45-1528b77fad43 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046908 Oct 20 13:41:18.108965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 375/750] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:41:18 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:18.731611 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:18.732208 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:18.739219 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:18.739687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:18.740127 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:18.740781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:18.741245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:18.741656 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:18.873142 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:18.881761 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:18.883211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:18.884358 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4e29666e-ff1d-43a4-86f7-745bffa4b95a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1722 microversion: 2.20 time: 0.156737 Oct 20 13:41:18.884938 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 376/751] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:18 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:19.121412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f7dff0e7-60cf-4a5f-b1d0-c97d7ce6826e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:19.123568 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f7dff0e7-60cf-4a5f-b1d0-c97d7ce6826e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:19.130557 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7dff0e7-60cf-4a5f-b1d0-c97d7ce6826e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:19.131038 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7dff0e7-60cf-4a5f-b1d0-c97d7ce6826e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:19.131464 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7dff0e7-60cf-4a5f-b1d0-c97d7ce6826e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:19.132150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7dff0e7-60cf-4a5f-b1d0-c97d7ce6826e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:19.132593 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7dff0e7-60cf-4a5f-b1d0-c97d7ce6826e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:19.133034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7dff0e7-60cf-4a5f-b1d0-c97d7ce6826e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:19.166617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f7dff0e7-60cf-4a5f-b1d0-c97d7ce6826e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049511 Oct 20 13:41:19.167724 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 377/752] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:41:19 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:19.501688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8f871d21-7f4f-44c3-a411-bff8982d37f2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:19.504157 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8f871d21-7f4f-44c3-a411-bff8982d37f2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:19.510342 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f871d21-7f4f-44c3-a411-bff8982d37f2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:19.511035 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f871d21-7f4f-44c3-a411-bff8982d37f2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:19.511235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f871d21-7f4f-44c3-a411-bff8982d37f2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:19.511913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f871d21-7f4f-44c3-a411-bff8982d37f2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:19.512369 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f871d21-7f4f-44c3-a411-bff8982d37f2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:19.512784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f871d21-7f4f-44c3-a411-bff8982d37f2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:19.542164 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8f871d21-7f4f-44c3-a411-bff8982d37f2 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044330 Oct 20 13:41:19.542721 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 378/753] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:41:19 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:19.553732 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7c4f1d3d-d4b4-4a7f-a16d-f39bf69e0c4d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:19.554214 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7c4f1d3d-d4b4-4a7f-a16d-f39bf69e0c4d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:19.559665 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c4f1d3d-d4b4-4a7f-a16d-f39bf69e0c4d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:19.560138 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c4f1d3d-d4b4-4a7f-a16d-f39bf69e0c4d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:19.560580 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c4f1d3d-d4b4-4a7f-a16d-f39bf69e0c4d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:19.561273 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c4f1d3d-d4b4-4a7f-a16d-f39bf69e0c4d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:19.561721 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c4f1d3d-d4b4-4a7f-a16d-f39bf69e0c4d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:19.562170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7c4f1d3d-d4b4-4a7f-a16d-f39bf69e0c4d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:19.590657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7c4f1d3d-d4b4-4a7f-a16d-f39bf69e0c4d tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments/2d8e94e1-4045-4523-a776-b195ad8dd4b9" status: 200 len: 194 microversion: 2.1 time: 0.041211 Oct 20 13:41:19.591223 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 379/754] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Oct 20 13:41:19 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments/2d8e94e1-4045-4523-a776-b195ad8dd4b9 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:19.909335 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:19.910063 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:19.916373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:19.916849 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:19.917477 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:19.918160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:19.918609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:19.919033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:20.055779 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:20.063802 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:20.065278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:20.066505 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0e720828-1f3a-489d-8f6f-38885baa1382 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1722 microversion: 2.20 time: 0.161057 Oct 20 13:41:20.067060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 380/755] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:19 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:20.178916 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-bb8ecdab-0f26-4bfc-9ac6-bd00135ff6ab tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:20.180989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-bb8ecdab-0f26-4bfc-9ac6-bd00135ff6ab tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:20.188907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb8ecdab-0f26-4bfc-9ac6-bd00135ff6ab tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:20.189390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb8ecdab-0f26-4bfc-9ac6-bd00135ff6ab tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:20.189818 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb8ecdab-0f26-4bfc-9ac6-bd00135ff6ab tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:20.191026 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb8ecdab-0f26-4bfc-9ac6-bd00135ff6ab tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:20.191616 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb8ecdab-0f26-4bfc-9ac6-bd00135ff6ab tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:20.192023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb8ecdab-0f26-4bfc-9ac6-bd00135ff6ab tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:20.220326 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-bb8ecdab-0f26-4bfc-9ac6-bd00135ff6ab tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045573 Oct 20 13:41:20.220884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 381/756] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:41:20 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 20 13:41:20.299674 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0b2873b1-c6ee-4027-998a-08fcdce75436 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:20.300181 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0b2873b1-c6ee-4027-998a-08fcdce75436 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:20.306047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0b2873b1-c6ee-4027-998a-08fcdce75436 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:20.306512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0b2873b1-c6ee-4027-998a-08fcdce75436 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:20.306932 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0b2873b1-c6ee-4027-998a-08fcdce75436 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:20.307601 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0b2873b1-c6ee-4027-998a-08fcdce75436 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:20.308043 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0b2873b1-c6ee-4027-998a-08fcdce75436 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:20.308455 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0b2873b1-c6ee-4027-998a-08fcdce75436 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:20.333725 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0b2873b1-c6ee-4027-998a-08fcdce75436 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:41:20.406258 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0b2873b1-c6ee-4027-998a-08fcdce75436 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 204 len: 0 microversion: 2.1 time: 0.110114 Oct 20 13:41:20.406850 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 382/757] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:41:20 2022] DELETE /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 20 13:41:20.415824 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5c81afed-0a8b-4a0f-80c1-5851fa0529c1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:20.416602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5c81afed-0a8b-4a0f-80c1-5851fa0529c1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:20.422440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c81afed-0a8b-4a0f-80c1-5851fa0529c1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:20.422920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c81afed-0a8b-4a0f-80c1-5851fa0529c1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:20.423351 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c81afed-0a8b-4a0f-80c1-5851fa0529c1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:20.424033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c81afed-0a8b-4a0f-80c1-5851fa0529c1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:20.424483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c81afed-0a8b-4a0f-80c1-5851fa0529c1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:20.425479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c81afed-0a8b-4a0f-80c1-5851fa0529c1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:20.553186 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5c81afed-0a8b-4a0f-80c1-5851fa0529c1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:20.561312 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5c81afed-0a8b-4a0f-80c1-5851fa0529c1 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1689 microversion: 2.1 time: 0.149820 Oct 20 13:41:20.562092 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 383/758] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:20 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:20.921099 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-89e25ef0-2fd4-4fa5-8891-0703d09a7da9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20011b77-fbc8-49bb-b24f-2d52d8e927e9"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:20.923440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-89e25ef0-2fd4-4fa5-8891-0703d09a7da9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:20.930641 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-89e25ef0-2fd4-4fa5-8891-0703d09a7da9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:20.931109 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-89e25ef0-2fd4-4fa5-8891-0703d09a7da9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:20.931531 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-89e25ef0-2fd4-4fa5-8891-0703d09a7da9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:20.932208 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-89e25ef0-2fd4-4fa5-8891-0703d09a7da9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:20.932653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-89e25ef0-2fd4-4fa5-8891-0703d09a7da9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:20.933097 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-89e25ef0-2fd4-4fa5-8891-0703d09a7da9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:24.310916 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-89e25ef0-2fd4-4fa5-8891-0703d09a7da9 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "POST /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.393520 Oct 20 13:41:24.312040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 384/759] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:41:20 2022] POST /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments => generated 194 bytes in 3395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:24.324974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:24.325733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:24.333407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:24.334085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:24.334677 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:24.335632 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:24.336122 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:24.337260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:24.570616 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:24.578608 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:24.580138 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:24.581453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-169a7376-bb1f-4978-b796-89f17c4a40da tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1743 microversion: 2.20 time: 0.268363 Oct 20 13:41:24.582102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 385/760] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:24 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1743 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:24.586559 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-49ac7e6f-dae4-4906-9191-fc7c1998fc63 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:24.587225 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-49ac7e6f-dae4-4906-9191-fc7c1998fc63 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:24.593136 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49ac7e6f-dae4-4906-9191-fc7c1998fc63 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:24.593614 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49ac7e6f-dae4-4906-9191-fc7c1998fc63 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:24.594039 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49ac7e6f-dae4-4906-9191-fc7c1998fc63 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:24.594714 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49ac7e6f-dae4-4906-9191-fc7c1998fc63 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:24.595156 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49ac7e6f-dae4-4906-9191-fc7c1998fc63 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:24.595569 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-49ac7e6f-dae4-4906-9191-fc7c1998fc63 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:24.822752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-49ac7e6f-dae4-4906-9191-fc7c1998fc63 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:24.830362 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-49ac7e6f-dae4-4906-9191-fc7c1998fc63 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1689 microversion: 2.1 time: 0.247259 Oct 20 13:41:24.831419 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 386/761] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:24 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1689 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:25.198792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-d64ae2d8-ec1d-44e0-bc3b-bf041a02d447 req-3f02209f-b211-431f-a452-9ed7ed5f66a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f326ad5-ca2f-4300-8676-2b6d7edfb108", "name": "network-vif-deleted", "tag": "61a2cacd-9e95-4421-956a-22d6ee9a27a3"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:25.205264 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:25.213442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-d64ae2d8-ec1d-44e0-bc3b-bf041a02d447 req-3f02209f-b211-431f-a452-9ed7ed5f66a2 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:25.214024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-d64ae2d8-ec1d-44e0-bc3b-bf041a02d447 req-3f02209f-b211-431f-a452-9ed7ed5f66a2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:25.214511 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-d64ae2d8-ec1d-44e0-bc3b-bf041a02d447 req-3f02209f-b211-431f-a452-9ed7ed5f66a2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:25.228513 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-d64ae2d8-ec1d-44e0-bc3b-bf041a02d447 req-3f02209f-b211-431f-a452-9ed7ed5f66a2 service nova] Creating event network-vif-deleted:61a2cacd-9e95-4421-956a-22d6ee9a27a3 for instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 on hv-cinder-86213 Oct 20 13:41:25.233876 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-d64ae2d8-ec1d-44e0-bc3b-bf041a02d447 req-3f02209f-b211-431f-a452-9ed7ed5f66a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038377 Oct 20 13:41:25.237396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 387/762] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:25.608114 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:25.608844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:25.616937 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:25.617439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:25.617871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:25.618592 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:25.619044 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:25.619493 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:25.751031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:25.759204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:25.760635 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:25.761861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4fdf0e19-f455-4ce0-9cb6-3b4b52370eb5 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1743 microversion: 2.20 time: 0.158121 Oct 20 13:41:25.762475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 388/763] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:25 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:25.854694 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:25.855232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:25.861619 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:25.862775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:25.863542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:25.864396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:25.864855 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:25.865323 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:25.887644 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:25.902807 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:25.903291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:25.903720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:25.904158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lazy-loading 'fault' on Instance uuid 5f326ad5-ca2f-4300-8676-2b6d7edfb108 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:25.954692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:25.964754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-59a18af8-aebb-4451-8987-0052144a21d4 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 200 len: 1335 microversion: 2.1 time: 0.114020 Oct 20 13:41:25.976937 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 389/764] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:25 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:26.788180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:26.788786 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:26.795188 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:26.795675 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:26.796110 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:26.796800 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:26.797283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:26.797705 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:27.116369 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:27.118489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:27.119987 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:27.121817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-be0616c6-a998-4c0b-a4d5-cd97489b90f0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.338271 Oct 20 13:41:27.122884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 390/765] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:26 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:27.128182 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:27.129066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 5f326ad5-ca2f-4300-8676-2b6d7edfb108] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:27.135850 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:27.136556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:27.137173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:27.138088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:27.138680 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:27.139240 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:27.153572 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] HTTP exception thrown: Instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 could not be found. Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Request method failure captured: Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 HTTP/1.1 Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU8EDd2vvUkyylhpotEJuKhlQDubD9a2W47vQITa7_dG2nMwmvFN7_QN2e2GI7GmwXpvLgSDZL0hzO6FAo5Na9GQVkD2x8Dg10Cs_2xd4l6hUlYtTtVpt4tIrTj8WeaKunzXxZGIY1rQk91fRfU3fGLHySl-I-o-9dOdjyRaOjT2KAc Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: f36e9fb394944eb0a0c2c0075dbc937c Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:41:27.155944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: f36e9fb394944eb0a0c2c0075dbc937c Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-ServerRescueNegativeTestJSON-1341728080-project Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 2dd45d3b097c46c28eb94c5e0bd2a7a6 Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1341728080-project Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 could not be found. Oct 20 13:41:27.158081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '5f326ad5-ca2f-4300-8676-2b6d7edfb108'} Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 could not be found. Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:41:27.159057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 could not be found. Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 could not be found. Oct 20 13:41:27.160543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:27.162524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Returning 404 to user: Instance 5f326ad5-ca2f-4300-8676-2b6d7edfb108 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:41:27.162524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e1c2b5f1-ac61-428e-a5ec-28840dade955 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108" status: 404 len: 111 microversion: 2.1 time: 0.032849 Oct 20 13:41:27.162524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 391/766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:27 2022] GET /compute/v2.1/servers/5f326ad5-ca2f-4300-8676-2b6d7edfb108 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:41:27.165795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0d733de5-a2d9-409a-9ba6-d96ccf54a691 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '.version_select at 0x7ffa12babca0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:27.187203 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0d733de5-a2d9-409a-9ba6-d96ccf54a691 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893496124" status: 202 len: 0 microversion: 2.1 time: 0.024980 Oct 20 13:41:27.187853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 392/767] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 20 13:41:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893496124 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:41:28.153673 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:28.155616 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:28.165688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:28.166547 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:28.167205 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:28.168161 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:28.169004 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:28.169654 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:28.572443 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:28.583159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:28.584977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:28.586242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cf23c618-f173-4814-a1a4-6dafebfd36c2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.437571 Oct 20 13:41:28.597371 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 393/768] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:28 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:29.612709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:29.614348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:29.621378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:29.622099 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:29.622695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:29.623566 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:29.624313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:29.624915 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:29.868204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:29.892497 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:29.894687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:29.895863 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b2318712-f9c6-4c32-af90-59f3efc31aec tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.287653 Oct 20 13:41:29.896600 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 394/769] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:29 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:29.959085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-6a19ad54-da6e-43bf-9047-c2bf07ea7107 req-d06c0f40-8e70-4af1-9b9d-1bb641e82e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34aa5d9-ed42-4cdd-bed0-229455d27cf1", "name": "network-vif-plugged", "status": "completed", "tag": "220d420d-8061-47e0-9323-3ec3344c20c6"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:29.970287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6a19ad54-da6e-43bf-9047-c2bf07ea7107 req-d06c0f40-8e70-4af1-9b9d-1bb641e82e42 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:29.970845 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6a19ad54-da6e-43bf-9047-c2bf07ea7107 req-d06c0f40-8e70-4af1-9b9d-1bb641e82e42 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:29.972053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6a19ad54-da6e-43bf-9047-c2bf07ea7107 req-d06c0f40-8e70-4af1-9b9d-1bb641e82e42 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:29.984533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-6a19ad54-da6e-43bf-9047-c2bf07ea7107 req-d06c0f40-8e70-4af1-9b9d-1bb641e82e42 service nova] Creating event network-vif-plugged:220d420d-8061-47e0-9323-3ec3344c20c6 for instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 on hv-cinder-86213 Oct 20 13:41:29.990748 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-6a19ad54-da6e-43bf-9047-c2bf07ea7107 req-d06c0f40-8e70-4af1-9b9d-1bb641e82e42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092820 Oct 20 13:41:29.991743 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 395/770] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:30.248363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2a7b3db1-44a3-452d-8545-ba1ce28b8cdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:30.249106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2a7b3db1-44a3-452d-8545-ba1ce28b8cdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:30.256179 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a7b3db1-44a3-452d-8545-ba1ce28b8cdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:30.256768 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a7b3db1-44a3-452d-8545-ba1ce28b8cdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:30.257249 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a7b3db1-44a3-452d-8545-ba1ce28b8cdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:30.257951 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a7b3db1-44a3-452d-8545-ba1ce28b8cdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:30.258439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a7b3db1-44a3-452d-8545-ba1ce28b8cdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:30.258864 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a7b3db1-44a3-452d-8545-ba1ce28b8cdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:30.291427 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2a7b3db1-44a3-452d-8545-ba1ce28b8cdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:41:30.405842 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2a7b3db1-44a3-452d-8545-ba1ce28b8cdd tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "DELETE /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 204 len: 0 microversion: 2.1 time: 0.160101 Oct 20 13:41:30.410376 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 396/771] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:41:30 2022] DELETE /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:41:30.416141 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-251e5d52-e50d-44ef-97bd-76f2d67dba2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:30.417109 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-251e5d52-e50d-44ef-97bd-76f2d67dba2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:30.423321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-251e5d52-e50d-44ef-97bd-76f2d67dba2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:30.423897 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-251e5d52-e50d-44ef-97bd-76f2d67dba2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:30.425351 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-251e5d52-e50d-44ef-97bd-76f2d67dba2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:30.426472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-251e5d52-e50d-44ef-97bd-76f2d67dba2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:30.427034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-251e5d52-e50d-44ef-97bd-76f2d67dba2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:30.427733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-251e5d52-e50d-44ef-97bd-76f2d67dba2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:30.584850 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-251e5d52-e50d-44ef-97bd-76f2d67dba2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:30.597547 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-251e5d52-e50d-44ef-97bd-76f2d67dba2f tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1508 microversion: 2.1 time: 0.185459 Oct 20 13:41:30.598230 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 397/772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:30 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:30.921835 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:30.922538 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:30.930488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:30.930976 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:30.931413 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:30.932117 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:30.932580 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:30.933027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:31.080116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:31.089431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:31.090879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:31.092102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-45a7b31a-323b-49ed-a24d-aacf3d6c26fb tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.174161 Oct 20 13:41:31.092668 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 398/773] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:30 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:31.621917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e8514e46-fe29-4fbf-a7a1-b742d8cbb734 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:31.622568 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e8514e46-fe29-4fbf-a7a1-b742d8cbb734 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:31.629564 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8514e46-fe29-4fbf-a7a1-b742d8cbb734 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:31.630060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8514e46-fe29-4fbf-a7a1-b742d8cbb734 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:31.630676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8514e46-fe29-4fbf-a7a1-b742d8cbb734 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:31.631416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8514e46-fe29-4fbf-a7a1-b742d8cbb734 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:31.631891 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8514e46-fe29-4fbf-a7a1-b742d8cbb734 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:31.632331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8514e46-fe29-4fbf-a7a1-b742d8cbb734 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:31.777096 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e8514e46-fe29-4fbf-a7a1-b742d8cbb734 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:31.786760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e8514e46-fe29-4fbf-a7a1-b742d8cbb734 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1508 microversion: 2.1 time: 0.169145 Oct 20 13:41:31.787542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 399/774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:31 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:32.118485 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:32.119317 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:32.126560 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:32.128154 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:32.128675 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:32.129460 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:32.130179 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:32.130792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:32.275567 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:32.285196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:32.286801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:32.288102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cd5885b7-e304-48f1-807a-da882389615e tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.173521 Oct 20 13:41:32.288797 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 400/775] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:32 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:32.809746 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-aac7842a-f6c0-4763-91fe-2d12a2234ba6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:32.810358 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-aac7842a-f6c0-4763-91fe-2d12a2234ba6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:32.817291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aac7842a-f6c0-4763-91fe-2d12a2234ba6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:32.817810 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aac7842a-f6c0-4763-91fe-2d12a2234ba6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:32.818326 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aac7842a-f6c0-4763-91fe-2d12a2234ba6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:32.819076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aac7842a-f6c0-4763-91fe-2d12a2234ba6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:32.819602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aac7842a-f6c0-4763-91fe-2d12a2234ba6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:32.820049 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aac7842a-f6c0-4763-91fe-2d12a2234ba6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:32.981391 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-aac7842a-f6c0-4763-91fe-2d12a2234ba6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:32.992039 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-aac7842a-f6c0-4763-91fe-2d12a2234ba6 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1508 microversion: 2.1 time: 0.186063 Oct 20 13:41:32.995428 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 401/776] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:32 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:33.319530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:33.320999 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:33.328009 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:33.328493 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:33.328949 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:33.329639 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:33.330083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:33.331093 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:33.478341 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:33.489048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:33.491202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:33.492654 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f7d07366-4cbc-4143-8843-77aaa3caab88 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.177973 Oct 20 13:41:33.510457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 402/777] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:33 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:34.017031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1474399b-741f-4fb7-b0a1-bed58e962160 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:34.017655 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1474399b-741f-4fb7-b0a1-bed58e962160 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:34.028780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1474399b-741f-4fb7-b0a1-bed58e962160 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.029308 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1474399b-741f-4fb7-b0a1-bed58e962160 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.029742 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1474399b-741f-4fb7-b0a1-bed58e962160 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.030463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1474399b-741f-4fb7-b0a1-bed58e962160 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.030922 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1474399b-741f-4fb7-b0a1-bed58e962160 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.031442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1474399b-741f-4fb7-b0a1-bed58e962160 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.164788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1474399b-741f-4fb7-b0a1-bed58e962160 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:34.172793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1474399b-741f-4fb7-b0a1-bed58e962160 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 200 len: 1466 microversion: 2.1 time: 0.159423 Oct 20 13:41:34.173237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 403/778] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:34 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 1466 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:34.177895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-7d920fc1-36cd-45c9-a215-7739e6dcb175 req-f9739137-e800-4e0b-abf6-2fb379e357a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979db05e-9dea-4267-9635-f5de10f841cb", "name": "network-vif-deleted", "tag": "84925d54-d97f-47b3-ab29-4c56913ec155"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:34.193537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7d920fc1-36cd-45c9-a215-7739e6dcb175 req-f9739137-e800-4e0b-abf6-2fb379e357a2 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.194132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7d920fc1-36cd-45c9-a215-7739e6dcb175 req-f9739137-e800-4e0b-abf6-2fb379e357a2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.194567 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7d920fc1-36cd-45c9-a215-7739e6dcb175 req-f9739137-e800-4e0b-abf6-2fb379e357a2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.212403 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-7d920fc1-36cd-45c9-a215-7739e6dcb175 req-f9739137-e800-4e0b-abf6-2fb379e357a2 service nova] Creating event network-vif-deleted:84925d54-d97f-47b3-ab29-4c56913ec155 for instance 979db05e-9dea-4267-9635-f5de10f841cb on hv-cinder-86213 Oct 20 13:41:34.218315 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-7d920fc1-36cd-45c9-a215-7739e6dcb175 req-f9739137-e800-4e0b-abf6-2fb379e357a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043943 Oct 20 13:41:34.219684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 404/779] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:34.250687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1843a900-64eb-4d3f-a0f1-8c970b94f528 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:34.255590 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1843a900-64eb-4d3f-a0f1-8c970b94f528 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:34.263518 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1843a900-64eb-4d3f-a0f1-8c970b94f528 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.264388 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1843a900-64eb-4d3f-a0f1-8c970b94f528 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.264674 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1843a900-64eb-4d3f-a0f1-8c970b94f528 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.265522 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1843a900-64eb-4d3f-a0f1-8c970b94f528 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.266072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1843a900-64eb-4d3f-a0f1-8c970b94f528 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.266711 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1843a900-64eb-4d3f-a0f1-8c970b94f528 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.314243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1843a900-64eb-4d3f-a0f1-8c970b94f528 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.068609 Oct 20 13:41:34.316109 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 405/780] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:41:34 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:34.477041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-08059e09-8fe5-42be-b044-d17add704c54 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:34.481075 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-08059e09-8fe5-42be-b044-d17add704c54 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:34.493404 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08059e09-8fe5-42be-b044-d17add704c54 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.494469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08059e09-8fe5-42be-b044-d17add704c54 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.495437 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08059e09-8fe5-42be-b044-d17add704c54 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.496629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08059e09-8fe5-42be-b044-d17add704c54 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.497275 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08059e09-8fe5-42be-b044-d17add704c54 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.498071 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08059e09-8fe5-42be-b044-d17add704c54 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.553618 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-08059e09-8fe5-42be-b044-d17add704c54 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments/2d8e94e1-4045-4523-a776-b195ad8dd4b9" status: 200 len: 194 microversion: 2.1 time: 0.083420 Oct 20 13:41:34.554906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 406/781] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Oct 20 13:41:34 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments/2d8e94e1-4045-4523-a776-b195ad8dd4b9 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:34.559984 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:34.561213 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:34.568765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.573607 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.574288 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.575193 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.576016 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.576487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.594425 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:34.730347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:34.740392 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:34.741887 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:34.743074 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e8af9a7e-cc91-46a5-8ada-ed5eedc2883b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.187093 Oct 20 13:41:34.743811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 407/782] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:34 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:34.748524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4b100358-9fd9-4b0e-85a4-76c85c5b9a32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:34.749132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4b100358-9fd9-4b0e-85a4-76c85c5b9a32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:34.755848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b100358-9fd9-4b0e-85a4-76c85c5b9a32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.756337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b100358-9fd9-4b0e-85a4-76c85c5b9a32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.756775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b100358-9fd9-4b0e-85a4-76c85c5b9a32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.757496 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b100358-9fd9-4b0e-85a4-76c85c5b9a32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:34.757954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b100358-9fd9-4b0e-85a4-76c85c5b9a32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:34.758401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4b100358-9fd9-4b0e-85a4-76c85c5b9a32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:34.856842 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-4b100358-9fd9-4b0e-85a4-76c85c5b9a32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'services' on Instance uuid 3d730923-3277-4e78-9365-a95c403e26d8 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:34.962826 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4b100358-9fd9-4b0e-85a4-76c85c5b9a32 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments/2d8e94e1-4045-4523-a776-b195ad8dd4b9" status: 202 len: 0 microversion: 2.1 time: 0.217560 Oct 20 13:41:34.963998 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 408/783] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:41:34 2022] DELETE /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments/2d8e94e1-4045-4523-a776-b195ad8dd4b9 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:41:35.200923 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:35.201911 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 979db05e-9dea-4267-9635-f5de10f841cb] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:35.208672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:35.209209 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:35.209639 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:35.210332 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:35.210786 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:35.213793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:35.229123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] HTTP exception thrown: Instance 979db05e-9dea-4267-9635-f5de10f841cb could not be found. Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Request method failure captured: Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb HTTP/1.1 Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU8EDd2vvUkyylhpotEJuKhlQDubD9a2W47vQITa7_dG2nMwmvFN7_QN2e2GI7GmwXpvLgSDZL0hzO6FAo5Na9GQVkD2x8Dg10Cs_2xd4l6hUlYtTtVpt4tIrTj8WeaKunzXxZGIY1rQk91fRfU3fGLHySl-I-o-9dOdjyRaOjT2KAc Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: f36e9fb394944eb0a0c2c0075dbc937c Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:41:35.230762 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: f36e9fb394944eb0a0c2c0075dbc937c Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-ServerRescueNegativeTestJSON-1341728080-project Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 2dd45d3b097c46c28eb94c5e0bd2a7a6 Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1341728080-project Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 979db05e-9dea-4267-9635-f5de10f841cb could not be found. Oct 20 13:41:35.232298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '979db05e-9dea-4267-9635-f5de10f841cb'} Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979db05e-9dea-4267-9635-f5de10f841cb could not be found. Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:41:35.233329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979db05e-9dea-4267-9635-f5de10f841cb could not be found. Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979db05e-9dea-4267-9635-f5de10f841cb could not be found. Oct 20 13:41:35.234609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:35.235836 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Returning 404 to user: Instance 979db05e-9dea-4267-9635-f5de10f841cb could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:41:35.236342 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a6bc2eae-6ad4-47e4-9f96-d65f30f6ba2e tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb" status: 404 len: 111 microversion: 2.1 time: 0.044168 Oct 20 13:41:35.237256 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 409/784] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:35 2022] GET /compute/v2.1/servers/979db05e-9dea-4267-9635-f5de10f841cb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:41:35.245226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5c9cce95-927b-4844-be2f-7088b8701022 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:35.245727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5c9cce95-927b-4844-be2f-7088b8701022 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:35.252835 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c9cce95-927b-4844-be2f-7088b8701022 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:35.253760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c9cce95-927b-4844-be2f-7088b8701022 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:35.254290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c9cce95-927b-4844-be2f-7088b8701022 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:35.255084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c9cce95-927b-4844-be2f-7088b8701022 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:35.255637 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c9cce95-927b-4844-be2f-7088b8701022 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:35.256561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5c9cce95-927b-4844-be2f-7088b8701022 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:35.284778 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5c9cce95-927b-4844-be2f-7088b8701022 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:41:35.374300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5c9cce95-927b-4844-be2f-7088b8701022 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "DELETE /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 204 len: 0 microversion: 2.1 time: 0.132674 Oct 20 13:41:35.375611 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 410/785] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:41:35 2022] DELETE /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:41:35.385260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-65a0c6c9-f2d3-4973-bee5-f932dd4f8219 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:35.386291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-65a0c6c9-f2d3-4973-bee5-f932dd4f8219 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:35.394681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-65a0c6c9-f2d3-4973-bee5-f932dd4f8219 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:35.395194 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-65a0c6c9-f2d3-4973-bee5-f932dd4f8219 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:35.395633 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-65a0c6c9-f2d3-4973-bee5-f932dd4f8219 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:35.396325 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-65a0c6c9-f2d3-4973-bee5-f932dd4f8219 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:35.396771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-65a0c6c9-f2d3-4973-bee5-f932dd4f8219 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:35.397217 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-65a0c6c9-f2d3-4973-bee5-f932dd4f8219 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:35.561414 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-65a0c6c9-f2d3-4973-bee5-f932dd4f8219 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:35.573728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-65a0c6c9-f2d3-4973-bee5-f932dd4f8219 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.192572 Oct 20 13:41:35.574622 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 411/786] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:35 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:35.780492 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:35.781720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:35.792139 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:35.792943 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:35.793489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:35.794256 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:35.794798 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:35.795336 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:35.944276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:35.952664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:35.954193 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:35.955488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-98f9dfcb-1bbd-4c4b-8ac8-d9a92ca332fd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.182275 Oct 20 13:41:35.956338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 412/787] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:35 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:36.597771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b932c41f-51a9-4ff9-a28f-fd6be9ad4796 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:36.598695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b932c41f-51a9-4ff9-a28f-fd6be9ad4796 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:36.605430 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b932c41f-51a9-4ff9-a28f-fd6be9ad4796 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:36.605911 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b932c41f-51a9-4ff9-a28f-fd6be9ad4796 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:36.606349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b932c41f-51a9-4ff9-a28f-fd6be9ad4796 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:36.607038 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b932c41f-51a9-4ff9-a28f-fd6be9ad4796 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:36.607485 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b932c41f-51a9-4ff9-a28f-fd6be9ad4796 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:36.607904 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b932c41f-51a9-4ff9-a28f-fd6be9ad4796 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:36.740918 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b932c41f-51a9-4ff9-a28f-fd6be9ad4796 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:36.749235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b932c41f-51a9-4ff9-a28f-fd6be9ad4796 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.156125 Oct 20 13:41:36.749794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 413/788] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:36 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:36.982238 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:36.982846 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:36.990235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:36.990651 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:36.991082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:36.991763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:36.992211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:36.992629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:37.125302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:37.134158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:37.135613 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:37.136778 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-6e2f1c74-7a4e-4b6a-994e-279908de1a1d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.158970 Oct 20 13:41:37.137369 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 414/789] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:36 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:37.772449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c595c61f-256b-41bf-9db0-a2e47b413f53 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:37.773111 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c595c61f-256b-41bf-9db0-a2e47b413f53 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:37.779543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c595c61f-256b-41bf-9db0-a2e47b413f53 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:37.780028 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c595c61f-256b-41bf-9db0-a2e47b413f53 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:37.780466 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c595c61f-256b-41bf-9db0-a2e47b413f53 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:37.781192 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c595c61f-256b-41bf-9db0-a2e47b413f53 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:37.781649 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c595c61f-256b-41bf-9db0-a2e47b413f53 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:37.782074 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c595c61f-256b-41bf-9db0-a2e47b413f53 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:37.909263 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c595c61f-256b-41bf-9db0-a2e47b413f53 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:37.916924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c595c61f-256b-41bf-9db0-a2e47b413f53 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.148360 Oct 20 13:41:37.917488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 415/790] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:37 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:38.162808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:38.163423 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:38.169334 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:38.169817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:38.170255 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:38.170944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:38.171401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:38.171822 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:38.302739 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:38.310826 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:38.312281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:38.313471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-eaf206f9-c40c-4191-92ce-709898a2013b tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.155091 Oct 20 13:41:38.314041 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 416/791] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:38 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:38.940302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0a481479-17c7-41e4-bb74-3d5444bcf9e9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:38.942051 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0a481479-17c7-41e4-bb74-3d5444bcf9e9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:38.948400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a481479-17c7-41e4-bb74-3d5444bcf9e9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:38.948878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a481479-17c7-41e4-bb74-3d5444bcf9e9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:38.949317 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a481479-17c7-41e4-bb74-3d5444bcf9e9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:38.950002 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a481479-17c7-41e4-bb74-3d5444bcf9e9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:38.950451 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a481479-17c7-41e4-bb74-3d5444bcf9e9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:38.950904 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a481479-17c7-41e4-bb74-3d5444bcf9e9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:39.080414 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0a481479-17c7-41e4-bb74-3d5444bcf9e9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:39.088297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0a481479-17c7-41e4-bb74-3d5444bcf9e9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.151970 Oct 20 13:41:39.088885 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 417/792] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:38 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:39.339583 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:39.340187 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:39.346131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:39.346609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:39.347744 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:39.348460 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:39.348934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:39.349385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:39.476479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:39.484630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:39.486137 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:39.487293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c25dcbd2-2f32-4bc4-b433-9cb0ee9cb3cf tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1738 microversion: 2.20 time: 0.151662 Oct 20 13:41:39.487858 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 418/793] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:39 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:40.111398 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7a94719a-fed5-4e3f-b613-d84910a655d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:40.112063 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7a94719a-fed5-4e3f-b613-d84910a655d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:40.119158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a94719a-fed5-4e3f-b613-d84910a655d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:40.119648 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a94719a-fed5-4e3f-b613-d84910a655d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:40.120350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a94719a-fed5-4e3f-b613-d84910a655d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:40.121099 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a94719a-fed5-4e3f-b613-d84910a655d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:40.121562 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a94719a-fed5-4e3f-b613-d84910a655d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:40.122091 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a94719a-fed5-4e3f-b613-d84910a655d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:40.407851 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7a94719a-fed5-4e3f-b613-d84910a655d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:40.416110 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7a94719a-fed5-4e3f-b613-d84910a655d9 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1522 microversion: 2.1 time: 0.308515 Oct 20 13:41:40.417021 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 419/794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:40 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:40.421659 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-39665611-40d7-44a9-8c96-af27b819e180 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:40.422156 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-39665611-40d7-44a9-8c96-af27b819e180 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:40.428511 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-39665611-40d7-44a9-8c96-af27b819e180 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:40.429048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-39665611-40d7-44a9-8c96-af27b819e180 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:40.429487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-39665611-40d7-44a9-8c96-af27b819e180 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:40.430177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-39665611-40d7-44a9-8c96-af27b819e180 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:40.430639 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-39665611-40d7-44a9-8c96-af27b819e180 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:40.431066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-39665611-40d7-44a9-8c96-af27b819e180 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:40.462034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-39665611-40d7-44a9-8c96-af27b819e180 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments/20011b77-fbc8-49bb-b24f-2d52d8e927e9" status: 200 len: 194 microversion: 2.1 time: 0.043910 Oct 20 13:41:40.462845 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 420/795] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Oct 20 13:41:40 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments/20011b77-fbc8-49bb-b24f-2d52d8e927e9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:40.474234 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ec88c898-2c4f-4ebc-8484-92dadb63cf6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:40.474415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ec88c898-2c4f-4ebc-8484-92dadb63cf6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:40.488942 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec88c898-2c4f-4ebc-8484-92dadb63cf6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:40.489486 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec88c898-2c4f-4ebc-8484-92dadb63cf6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:40.489935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec88c898-2c4f-4ebc-8484-92dadb63cf6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:40.490638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec88c898-2c4f-4ebc-8484-92dadb63cf6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:40.491089 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec88c898-2c4f-4ebc-8484-92dadb63cf6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:40.491511 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ec88c898-2c4f-4ebc-8484-92dadb63cf6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:40.582740 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-ec88c898-2c4f-4ebc-8484-92dadb63cf6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'services' on Instance uuid 3d730923-3277-4e78-9365-a95c403e26d8 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:40.587698 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:40.656721 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ec88c898-2c4f-4ebc-8484-92dadb63cf6f tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments/20011b77-fbc8-49bb-b24f-2d52d8e927e9" status: 202 len: 0 microversion: 2.1 time: 0.187334 Oct 20 13:41:40.657342 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 421/796] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:41:40 2022] DELETE /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments/20011b77-fbc8-49bb-b24f-2d52d8e927e9 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 13:41:40.662475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:40.663164 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:40.669259 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:40.669739 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:40.670170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:40.670846 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:40.671295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:40.671709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:40.799866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:40.808480 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:40.809993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:40.811156 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-218f9053-2fb8-48db-a82d-4f5a91858d51 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1720 microversion: 2.20 time: 0.152767 Oct 20 13:41:40.811707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 422/797] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:40 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:40.816581 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-1475849e-c066-4cf7-bd36-be1025a9c237 req-0b1e4bf8-001c-4721-926c-bb91b082b5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81af22d4-c2fa-4c17-9ab2-8cd63758321a", "name": "network-vif-deleted", "tag": "ab34bd74-48bb-4f18-9a6f-ee06abb4b0e4"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:40.825970 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-1475849e-c066-4cf7-bd36-be1025a9c237 req-0b1e4bf8-001c-4721-926c-bb91b082b5ae service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:40.826327 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-1475849e-c066-4cf7-bd36-be1025a9c237 req-0b1e4bf8-001c-4721-926c-bb91b082b5ae service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:40.826794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-1475849e-c066-4cf7-bd36-be1025a9c237 req-0b1e4bf8-001c-4721-926c-bb91b082b5ae service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:40.838985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-1475849e-c066-4cf7-bd36-be1025a9c237 req-0b1e4bf8-001c-4721-926c-bb91b082b5ae service nova] Creating event network-vif-deleted:ab34bd74-48bb-4f18-9a6f-ee06abb4b0e4 for instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a on hv-cinder-86213 Oct 20 13:41:40.843742 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-1475849e-c066-4cf7-bd36-be1025a9c237 req-0b1e4bf8-001c-4721-926c-bb91b082b5ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030892 Oct 20 13:41:40.844337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 423/798] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:41.441468 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-27677163-d769-4c71-801b-f2b58303a0e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:41.442169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-27677163-d769-4c71-801b-f2b58303a0e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:41.448302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27677163-d769-4c71-801b-f2b58303a0e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:41.448783 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27677163-d769-4c71-801b-f2b58303a0e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:41.449250 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27677163-d769-4c71-801b-f2b58303a0e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:41.449938 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27677163-d769-4c71-801b-f2b58303a0e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:41.450391 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27677163-d769-4c71-801b-f2b58303a0e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:41.450820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-27677163-d769-4c71-801b-f2b58303a0e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:41.516262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-27677163-d769-4c71-801b-f2b58303a0e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:41.524063 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-27677163-d769-4c71-801b-f2b58303a0e5 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1307 microversion: 2.1 time: 0.088049 Oct 20 13:41:41.524623 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 424/799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:41 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:41.836925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:41.837531 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:41.843531 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:41.844033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:41.844463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:41.845157 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:41.845603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:41.846020 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:41.973048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:41.980966 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:41.982392 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:41.983524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-82cc3b53-297f-459b-927c-1fb04ff24c39 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1720 microversion: 2.20 time: 0.150512 Oct 20 13:41:41.984082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 425/800] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:41 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:42.547209 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:42.547820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:42.554281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:42.554768 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:42.555204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:42.555898 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:42.556352 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:42.556779 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:42.590441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:42.590919 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:42.591715 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:42.592164 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lazy-loading 'fault' on Instance uuid 81af22d4-c2fa-4c17-9ab2-8cd63758321a {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:42.634812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd45d3b097c46c28eb94c5e0bd2a7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36e9fb394944eb0a0c2c0075dbc937c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:42.643520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b44a64cb-a889-4873-a36d-f21fc2090ca2 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 200 len: 1312 microversion: 2.1 time: 0.100151 Oct 20 13:41:42.656853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 426/801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:42 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:43.009723 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:43.010318 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:43.016343 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.016817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.017276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.017951 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.018578 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.019149 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.177481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:43.187735 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:43.189834 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:43.191148 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f15f42c7-5594-4fe7-be7b-04cdc32e2129 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1723 microversion: 2.20 time: 0.185371 Oct 20 13:41:43.197291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 427/802] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:43 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:43.217512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d34045db-7106-467c-bb40-0e363f96381a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f183f896-b952-40e8-bf7c-42628f44f932"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:43.220374 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d34045db-7106-467c-bb40-0e363f96381a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:43.223965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:43.229604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d34045db-7106-467c-bb40-0e363f96381a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.230145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d34045db-7106-467c-bb40-0e363f96381a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.230646 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d34045db-7106-467c-bb40-0e363f96381a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.231371 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d34045db-7106-467c-bb40-0e363f96381a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.231795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d34045db-7106-467c-bb40-0e363f96381a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.232305 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d34045db-7106-467c-bb40-0e363f96381a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.501096 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d34045db-7106-467c-bb40-0e363f96381a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "POST /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287738 Oct 20 13:41:43.501701 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 428/803] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Oct 20 13:41:43 2022] POST /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 13:41:43.635542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c7f5444f-635f-429e-9d1d-bb9708f3770a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:43.636210 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c7f5444f-635f-429e-9d1d-bb9708f3770a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:43.642553 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7f5444f-635f-429e-9d1d-bb9708f3770a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.643044 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7f5444f-635f-429e-9d1d-bb9708f3770a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.643479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7f5444f-635f-429e-9d1d-bb9708f3770a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.644192 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7f5444f-635f-429e-9d1d-bb9708f3770a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.644642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7f5444f-635f-429e-9d1d-bb9708f3770a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.645091 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7f5444f-635f-429e-9d1d-bb9708f3770a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.885148 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c7f5444f-635f-429e-9d1d-bb9708f3770a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/os-volume_attachments/f183f896-b952-40e8-bf7c-42628f44f932" status: 202 len: 0 microversion: 2.20 time: 0.253340 Oct 20 13:41:43.885873 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 429/804] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Oct 20 13:41:43 2022] DELETE /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/os-volume_attachments/f183f896-b952-40e8-bf7c-42628f44f932 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:41:43.890946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:43.891699 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] [instance: 81af22d4-c2fa-4c17-9ab2-8cd63758321a] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:43.900652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.901182 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.901625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.902338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.902797 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.903227 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.917924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] HTTP exception thrown: Instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a could not be found. Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Request method failure captured: Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a HTTP/1.1 Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU8EDd2vvUkyylhpotEJuKhlQDubD9a2W47vQITa7_dG2nMwmvFN7_QN2e2GI7GmwXpvLgSDZL0hzO6FAo5Na9GQVkD2x8Dg10Cs_2xd4l6hUlYtTtVpt4tIrTj8WeaKunzXxZGIY1rQk91fRfU3fGLHySl-I-o-9dOdjyRaOjT2KAc Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: f36e9fb394944eb0a0c2c0075dbc937c Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:41:43.919617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f36e9fb394944eb0a0c2c0075dbc937c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: f36e9fb394944eb0a0c2c0075dbc937c Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1341728080 Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-ServerRescueNegativeTestJSON-1341728080-project Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 2dd45d3b097c46c28eb94c5e0bd2a7a6 Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1341728080-project Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a could not be found. Oct 20 13:41:43.921204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '81af22d4-c2fa-4c17-9ab2-8cd63758321a'} Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a could not be found. Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:41:43.925688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a could not be found. Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a could not be found. Oct 20 13:41:43.927977 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:43.929697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] Returning 404 to user: Instance 81af22d4-c2fa-4c17-9ab2-8cd63758321a could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:41:43.929697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-69e79d87-dd18-417c-8ca4-a00984cab695 tempest-ServerRescueNegativeTestJSON-1341728080 tempest-ServerRescueNegativeTestJSON-1341728080-project] 10.222.0.23 "GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a" status: 404 len: 111 microversion: 2.1 time: 0.034030 Oct 20 13:41:43.929697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 430/805] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:43 2022] GET /compute/v2.1/servers/81af22d4-c2fa-4c17-9ab2-8cd63758321a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:41:43.929697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-3aa8e160-19c3-413b-ac51-0b702feb81a1 req-0ef8b8be-2bab-4977-99f1-72964edd1ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34aa5d9-ed42-4cdd-bed0-229455d27cf1", "name": "network-vif-unplugged", "status": "completed", "tag": "220d420d-8061-47e0-9323-3ec3344c20c6"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:43.945076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-3aa8e160-19c3-413b-ac51-0b702feb81a1 req-0ef8b8be-2bab-4977-99f1-72964edd1ab4 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.945076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-3aa8e160-19c3-413b-ac51-0b702feb81a1 req-0ef8b8be-2bab-4977-99f1-72964edd1ab4 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.945076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-3aa8e160-19c3-413b-ac51-0b702feb81a1 req-0ef8b8be-2bab-4977-99f1-72964edd1ab4 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.949377 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.compute.server_external_events [req-3aa8e160-19c3-413b-ac51-0b702feb81a1 req-0ef8b8be-2bab-4977-99f1-72964edd1ab4 service nova] Unable to find a host for instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1. Dropping event network-vif-unplugged {{(pid=125448) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 20 13:41:43.949975 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-3aa8e160-19c3-413b-ac51-0b702feb81a1 req-0ef8b8be-2bab-4977-99f1-72964edd1ab4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027378 Oct 20 13:41:43.953775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 431/806] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 20 13:41:43.959082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3a86cd66-8bb7-41b0-8e7e-a61e22cf523b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:43.961278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3a86cd66-8bb7-41b0-8e7e-a61e22cf523b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:43.967393 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3a86cd66-8bb7-41b0-8e7e-a61e22cf523b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.967879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3a86cd66-8bb7-41b0-8e7e-a61e22cf523b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.968314 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3a86cd66-8bb7-41b0-8e7e-a61e22cf523b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.969048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3a86cd66-8bb7-41b0-8e7e-a61e22cf523b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:43.969522 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3a86cd66-8bb7-41b0-8e7e-a61e22cf523b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:43.969928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3a86cd66-8bb7-41b0-8e7e-a61e22cf523b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:43.999429 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3a86cd66-8bb7-41b0-8e7e-a61e22cf523b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044624 Oct 20 13:41:44.000203 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 432/807] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:41:43 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 13:41:44.006119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6650d218-1640-4e3f-ba89-9eb7a4b7db16 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:44.006710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6650d218-1640-4e3f-ba89-9eb7a4b7db16 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:44.012551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6650d218-1640-4e3f-ba89-9eb7a4b7db16 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:44.013293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6650d218-1640-4e3f-ba89-9eb7a4b7db16 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:44.013577 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6650d218-1640-4e3f-ba89-9eb7a4b7db16 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:44.014267 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6650d218-1640-4e3f-ba89-9eb7a4b7db16 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:44.014728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6650d218-1640-4e3f-ba89-9eb7a4b7db16 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:44.015153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6650d218-1640-4e3f-ba89-9eb7a4b7db16 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:44.046607 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6650d218-1640-4e3f-ba89-9eb7a4b7db16 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125448) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 20 13:41:44.131103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:44.148747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-6650d218-1640-4e3f-ba89-9eb7a4b7db16 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "POST /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/action" status: 202 len: 0 microversion: 2.20 time: 0.147542 Oct 20 13:41:44.149567 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 433/808] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 20 13:41:43 2022] POST /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:41:44.155753 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e9881c0a-febe-4f6e-b6cf-f9efa10bb6fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:44.158770 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e9881c0a-febe-4f6e-b6cf-f9efa10bb6fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:44.166525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9881c0a-febe-4f6e-b6cf-f9efa10bb6fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:44.167020 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9881c0a-febe-4f6e-b6cf-f9efa10bb6fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:44.167515 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9881c0a-febe-4f6e-b6cf-f9efa10bb6fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:44.168714 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9881c0a-febe-4f6e-b6cf-f9efa10bb6fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:44.169232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9881c0a-febe-4f6e-b6cf-f9efa10bb6fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:44.169697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9881c0a-febe-4f6e-b6cf-f9efa10bb6fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:44.216089 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e9881c0a-febe-4f6e-b6cf-f9efa10bb6fe tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065641 Oct 20 13:41:44.216948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 434/809] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:41:44 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 13:41:44.222139 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:44.223118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:44.231740 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:44.232433 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:44.232964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:44.233722 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:44.234236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:44.234738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:44.404198 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:44.413774 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:44.415255 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:44.416416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a2e2c249-8874-458b-bb7f-98b41a81ef69 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1671 microversion: 2.20 time: 0.198345 Oct 20 13:41:44.417001 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 435/810] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:44 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1671 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:44.421510 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-22cb506a-f973-4f79-a24a-a6a387ffc3ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:44.422019 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-22cb506a-f973-4f79-a24a-a6a387ffc3ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:44.429165 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-22cb506a-f973-4f79-a24a-a6a387ffc3ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:44.429652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-22cb506a-f973-4f79-a24a-a6a387ffc3ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:44.430140 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-22cb506a-f973-4f79-a24a-a6a387ffc3ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:44.431037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-22cb506a-f973-4f79-a24a-a6a387ffc3ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:44.432127 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-22cb506a-f973-4f79-a24a-a6a387ffc3ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:44.432561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-22cb506a-f973-4f79-a24a-a6a387ffc3ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:44.460015 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-22cb506a-f973-4f79-a24a-a6a387ffc3ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:41:44.544660 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-22cb506a-f973-4f79-a24a-a6a387ffc3ff tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 204 len: 0 microversion: 2.1 time: 0.126409 Oct 20 13:41:44.548413 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 436/811] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:41:44 2022] DELETE /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:41:44.557066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-023e258f-613e-4962-b4bf-27de112eee9b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:44.557932 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-023e258f-613e-4962-b4bf-27de112eee9b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:44.564629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-023e258f-613e-4962-b4bf-27de112eee9b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:44.565261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-023e258f-613e-4962-b4bf-27de112eee9b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:44.565702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-023e258f-613e-4962-b4bf-27de112eee9b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:44.566406 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-023e258f-613e-4962-b4bf-27de112eee9b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:44.567025 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-023e258f-613e-4962-b4bf-27de112eee9b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:44.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-023e258f-613e-4962-b4bf-27de112eee9b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:44.718476 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-023e258f-613e-4962-b4bf-27de112eee9b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:44.727192 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-023e258f-613e-4962-b4bf-27de112eee9b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1670 microversion: 2.1 time: 0.177529 Oct 20 13:41:44.727776 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 437/812] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:44 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:45.442449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:45.443514 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:45.450015 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:45.450502 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:45.450985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:45.451625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:45.452068 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:45.452484 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:45.680199 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:45.689609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:45.691487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:45.694198 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-40cecc69-7a1c-4819-9974-8a4ee994848d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1671 microversion: 2.20 time: 0.256207 Oct 20 13:41:45.709901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 438/813] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:45 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1671 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:45.752757 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ebcc8c40-95ee-4a7e-9ae1-82119286268b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:45.754349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ebcc8c40-95ee-4a7e-9ae1-82119286268b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:45.767161 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ebcc8c40-95ee-4a7e-9ae1-82119286268b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:45.768040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ebcc8c40-95ee-4a7e-9ae1-82119286268b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:45.769776 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ebcc8c40-95ee-4a7e-9ae1-82119286268b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:45.772456 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ebcc8c40-95ee-4a7e-9ae1-82119286268b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:45.773256 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ebcc8c40-95ee-4a7e-9ae1-82119286268b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:45.774413 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ebcc8c40-95ee-4a7e-9ae1-82119286268b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:46.029973 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ebcc8c40-95ee-4a7e-9ae1-82119286268b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:46.039667 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ebcc8c40-95ee-4a7e-9ae1-82119286268b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1670 microversion: 2.1 time: 0.291609 Oct 20 13:41:46.040709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 439/814] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:45 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1670 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:46.724292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:46.725089 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:46.732200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:46.732683 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:46.735196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:46.736102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:46.736215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:46.739741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:47.085686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:47.093868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:47.095322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:47.096547 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-63219b94-0486-4bdb-ad65-580d804391ad tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.377001 Oct 20 13:41:47.097149 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 440/815] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:46 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:47.101745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7735c028-0dd5-4df3-a5ca-eaf2c658d4df tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:47.102300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7735c028-0dd5-4df3-a5ca-eaf2c658d4df tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:47.108144 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7735c028-0dd5-4df3-a5ca-eaf2c658d4df tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:47.108630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7735c028-0dd5-4df3-a5ca-eaf2c658d4df tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:47.109108 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7735c028-0dd5-4df3-a5ca-eaf2c658d4df tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:47.109805 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7735c028-0dd5-4df3-a5ca-eaf2c658d4df tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:47.110259 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7735c028-0dd5-4df3-a5ca-eaf2c658d4df tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:47.110686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7735c028-0dd5-4df3-a5ca-eaf2c658d4df tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:47.514642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7735c028-0dd5-4df3-a5ca-eaf2c658d4df tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:47.529485 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7735c028-0dd5-4df3-a5ca-eaf2c658d4df tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1670 microversion: 2.1 time: 0.428828 Oct 20 13:41:47.531014 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 441/816] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:47 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1670 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:48.128276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:48.130453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:48.136721 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:48.137313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:48.137835 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:48.138604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:48.139123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:48.144322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:48.399463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:48.413174 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:48.429118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:48.430735 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cdd01062-f5eb-4cd7-86c5-c6a63c418d33 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.310990 Oct 20 13:41:48.433010 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 442/817] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:48 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:48.445876 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-94defe34-f79d-425d-8fc8-a6b7148ff049 req-01d73768-55c0-4d67-b135-704c10bb3a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d730923-3277-4e78-9365-a95c403e26d8", "name": "network-vif-deleted", "tag": "4c0b67a4-d502-4fe0-8fb2-21290e8ba8ea"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:48.471551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-94defe34-f79d-425d-8fc8-a6b7148ff049 req-01d73768-55c0-4d67-b135-704c10bb3a17 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:48.472044 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-94defe34-f79d-425d-8fc8-a6b7148ff049 req-01d73768-55c0-4d67-b135-704c10bb3a17 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:48.472477 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-94defe34-f79d-425d-8fc8-a6b7148ff049 req-01d73768-55c0-4d67-b135-704c10bb3a17 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:48.490248 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-94defe34-f79d-425d-8fc8-a6b7148ff049 req-01d73768-55c0-4d67-b135-704c10bb3a17 service nova] Creating event network-vif-deleted:4c0b67a4-d502-4fe0-8fb2-21290e8ba8ea for instance 3d730923-3277-4e78-9365-a95c403e26d8 on hv-cinder-86213 Oct 20 13:41:48.512116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-94defe34-f79d-425d-8fc8-a6b7148ff049 req-01d73768-55c0-4d67-b135-704c10bb3a17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070235 Oct 20 13:41:48.513787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 443/818] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:48.558223 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:48.559268 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:48.566632 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:48.567765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:48.568846 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:48.569935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:48.570377 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:48.570805 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:48.639058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:48.639647 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:48.640156 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:48.640678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'fault' on Instance uuid 3d730923-3277-4e78-9365-a95c403e26d8 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:48.720275 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:48.731010 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-dc6c98e1-959d-41bc-9760-f9e6bfc53aca tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1326 microversion: 2.1 time: 0.180453 Oct 20 13:41:48.733140 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 444/819] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:48 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1326 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:49.407204 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a925b041-d7be-45fb-9163-83f895185ad1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:49.412132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a925b041-d7be-45fb-9163-83f895185ad1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:49.430784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a925b041-d7be-45fb-9163-83f895185ad1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:49.432584 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a925b041-d7be-45fb-9163-83f895185ad1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:49.433937 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a925b041-d7be-45fb-9163-83f895185ad1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:49.436120 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a925b041-d7be-45fb-9163-83f895185ad1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:49.437442 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a925b041-d7be-45fb-9163-83f895185ad1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:49.437988 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a925b041-d7be-45fb-9163-83f895185ad1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:49.585727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a925b041-d7be-45fb-9163-83f895185ad1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "POST /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/action" status: 202 len: 0 microversion: 2.1 time: 0.181852 Oct 20 13:41:49.586698 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 445/820] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:41:49 2022] POST /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 13:41:49.597521 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:49.601858 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:49.609182 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:49.610349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:49.610794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:49.611582 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:49.612157 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:49.612927 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:49.909181 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:49.919002 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:49.920799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:49.922473 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5ae0bdfd-bfac-443b-a399-33e74a939143 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.334696 Oct 20 13:41:49.937446 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 446/821] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:49 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:49.953071 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2542ff52-c323-4a14-b4d0-4295d369ae9f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:49.953695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2542ff52-c323-4a14-b4d0-4295d369ae9f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:49.963586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2542ff52-c323-4a14-b4d0-4295d369ae9f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:49.964077 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2542ff52-c323-4a14-b4d0-4295d369ae9f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:49.964510 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2542ff52-c323-4a14-b4d0-4295d369ae9f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:49.965307 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2542ff52-c323-4a14-b4d0-4295d369ae9f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:49.965757 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2542ff52-c323-4a14-b4d0-4295d369ae9f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:49.966195 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2542ff52-c323-4a14-b4d0-4295d369ae9f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:50.170173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2542ff52-c323-4a14-b4d0-4295d369ae9f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:50.182876 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2542ff52-c323-4a14-b4d0-4295d369ae9f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1750 microversion: 2.1 time: 0.236331 Oct 20 13:41:50.184738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 447/822] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:49 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1750 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:50.191202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:50.192145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:50.199321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:50.200218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:50.200800 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:50.201576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:50.202403 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:50.202680 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:50.207520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:50.247583 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:50.248069 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:50.248663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:50.249149 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'fault' on Instance uuid 3d730923-3277-4e78-9365-a95c403e26d8 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:50.296347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:50.305691 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d5c294d3-c64c-453b-9cbc-bfa1a678fcb6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1326 microversion: 2.1 time: 0.119508 Oct 20 13:41:50.306273 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 448/823] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:50 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:50.951536 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:50.952200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:50.959508 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:50.960234 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:50.960910 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:50.961811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:50.962412 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:50.963043 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:51.142177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:51.152025 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:51.153689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:51.155935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cd81b966-164e-47a2-b1d8-0f05332ff526 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.208348 Oct 20 13:41:51.161082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 449/824] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:50 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:51.209215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fa5b98c8-fb72-4389-93f2-4ff086b18b9c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:51.210032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fa5b98c8-fb72-4389-93f2-4ff086b18b9c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:51.222288 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa5b98c8-fb72-4389-93f2-4ff086b18b9c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:51.222908 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa5b98c8-fb72-4389-93f2-4ff086b18b9c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:51.225383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa5b98c8-fb72-4389-93f2-4ff086b18b9c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:51.226286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa5b98c8-fb72-4389-93f2-4ff086b18b9c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:51.231078 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa5b98c8-fb72-4389-93f2-4ff086b18b9c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:51.231508 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fa5b98c8-fb72-4389-93f2-4ff086b18b9c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:51.404282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fa5b98c8-fb72-4389-93f2-4ff086b18b9c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:51.424613 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fa5b98c8-fb72-4389-93f2-4ff086b18b9c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1750 microversion: 2.1 time: 0.221046 Oct 20 13:41:51.443806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 450/825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:51 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1750 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:51.444189 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:51.444721 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:51.453153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:51.455054 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:51.455809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:51.456933 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:51.458478 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:51.459150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:51.510426 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:51.510929 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:51.512663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:51.513383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'fault' on Instance uuid 3d730923-3277-4e78-9365-a95c403e26d8 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:51.567739 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:51.578355 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8caaf2e5-4120-480b-8158-47ab9380c665 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1326 microversion: 2.1 time: 0.138383 Oct 20 13:41:51.593341 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 451/826] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:51 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:52.188690 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:52.189457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:52.198658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:52.199146 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:52.199576 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:52.200281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:52.200728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:52.201371 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:52.401017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:52.412441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:52.415115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:52.417011 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3ce27f6f-6a34-423d-9e56-64eabda8dfae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.233409 Oct 20 13:41:52.417780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 452/827] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:52 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:52.459084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b60b6db9-b16d-40f4-b68e-9bc9a4590bbf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:52.459958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b60b6db9-b16d-40f4-b68e-9bc9a4590bbf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:52.466246 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b60b6db9-b16d-40f4-b68e-9bc9a4590bbf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:52.467010 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b60b6db9-b16d-40f4-b68e-9bc9a4590bbf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:52.467655 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b60b6db9-b16d-40f4-b68e-9bc9a4590bbf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:52.468705 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b60b6db9-b16d-40f4-b68e-9bc9a4590bbf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:52.469370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b60b6db9-b16d-40f4-b68e-9bc9a4590bbf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:52.469989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b60b6db9-b16d-40f4-b68e-9bc9a4590bbf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:52.684811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b60b6db9-b16d-40f4-b68e-9bc9a4590bbf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:52.699315 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b60b6db9-b16d-40f4-b68e-9bc9a4590bbf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1750 microversion: 2.1 time: 0.249983 Oct 20 13:41:52.704213 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 453/828] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:52 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1750 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:52.730547 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:52.731477 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:52.743409 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:52.743900 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:52.744724 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:52.745644 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:52.746166 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:52.746714 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:52.787839 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:52.788604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:52.789178 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:52.790636 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'fault' on Instance uuid 3d730923-3277-4e78-9365-a95c403e26d8 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:52.839393 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:52.857103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fb7ea4a1-1ddc-44d3-96c3-fd3a24ed5632 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1326 microversion: 2.1 time: 0.142576 Oct 20 13:41:52.857720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 454/829] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:52 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:53.446343 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:53.447886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:53.454234 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:53.454914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:53.455527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:53.456408 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:53.457581 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:53.458350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:53.620609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:53.630060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:53.637395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:53.641712 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-de6847b4-52c5-4d89-b873-1183dd33c00a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.201594 Oct 20 13:41:53.643929 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 455/830] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:53 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:53.732044 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3b1792fb-9a38-46fa-8993-880ef24a1322 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:53.732555 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3b1792fb-9a38-46fa-8993-880ef24a1322 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:53.741524 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b1792fb-9a38-46fa-8993-880ef24a1322 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:53.742018 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b1792fb-9a38-46fa-8993-880ef24a1322 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:53.742455 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b1792fb-9a38-46fa-8993-880ef24a1322 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:53.743165 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b1792fb-9a38-46fa-8993-880ef24a1322 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:53.743629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b1792fb-9a38-46fa-8993-880ef24a1322 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:53.744053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3b1792fb-9a38-46fa-8993-880ef24a1322 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:54.146915 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3b1792fb-9a38-46fa-8993-880ef24a1322 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:54.156785 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3b1792fb-9a38-46fa-8993-880ef24a1322 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1750 microversion: 2.1 time: 0.428570 Oct 20 13:41:54.157399 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 456/831] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:53 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1750 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:54.165156 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:54.165981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:54.172286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:54.173058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:54.173656 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:54.174517 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:54.175119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:54.175691 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:54.225503 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:54.226252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:54.226687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:54.227129 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'fault' on Instance uuid 3d730923-3277-4e78-9365-a95c403e26d8 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:54.272668 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:54.282006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8fe32936-0040-465c-baf7-9f6fb7e7111b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1326 microversion: 2.1 time: 0.122825 Oct 20 13:41:54.282585 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 457/832] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:54 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:54.670821 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:54.672432 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:54.684662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:54.685459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:54.685997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:54.687159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:54.687861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:54.688303 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:54.861851 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:54.872183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:54.873764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:54.875034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fac3fbac-ee7f-48f8-aaf7-2a018e072a5f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.209578 Oct 20 13:41:54.888894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 458/833] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:54 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:41:55.182008 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a3f1a2fd-66cc-4df7-9a83-3a3679f81d0c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:55.182625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a3f1a2fd-66cc-4df7-9a83-3a3679f81d0c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:55.189776 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3f1a2fd-66cc-4df7-9a83-3a3679f81d0c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:55.190281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3f1a2fd-66cc-4df7-9a83-3a3679f81d0c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:55.190714 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3f1a2fd-66cc-4df7-9a83-3a3679f81d0c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:55.192273 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3f1a2fd-66cc-4df7-9a83-3a3679f81d0c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:55.192716 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3f1a2fd-66cc-4df7-9a83-3a3679f81d0c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:55.193207 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3f1a2fd-66cc-4df7-9a83-3a3679f81d0c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:55.390190 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a3f1a2fd-66cc-4df7-9a83-3a3679f81d0c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:55.402170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a3f1a2fd-66cc-4df7-9a83-3a3679f81d0c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1750 microversion: 2.1 time: 0.223512 Oct 20 13:41:55.412891 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 459/834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:55 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1750 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:55.420671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:55.420671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:55.432645 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:55.434269 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:55.435297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:55.436237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:55.437537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:55.439448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:55.478871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:55.479446 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:55.480013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:55.480503 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'fault' on Instance uuid 3d730923-3277-4e78-9365-a95c403e26d8 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:55.535820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:55.550562 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-271e7394-2c75-47b6-a84a-2baab4bee782 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1326 microversion: 2.1 time: 0.145549 Oct 20 13:41:55.551627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 460/835] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:55 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:55.901529 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:55.902195 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:55.913064 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:55.913673 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:55.914173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:55.914986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:55.915518 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:55.916033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:56.069858 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:56.079013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:56.080535 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:56.082549 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-aabc2342-d572-470a-a6db-7d93246077f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.184912 Oct 20 13:41:56.094974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 461/836] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:55 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:56.430170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-88ce3225-3471-44a5-b52c-9494349d2657 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:56.431867 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-88ce3225-3471-44a5-b52c-9494349d2657 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:56.439211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-88ce3225-3471-44a5-b52c-9494349d2657 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:56.444716 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-88ce3225-3471-44a5-b52c-9494349d2657 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:56.445326 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-88ce3225-3471-44a5-b52c-9494349d2657 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:56.446281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-88ce3225-3471-44a5-b52c-9494349d2657 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:56.447250 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-88ce3225-3471-44a5-b52c-9494349d2657 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:56.448302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-88ce3225-3471-44a5-b52c-9494349d2657 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:56.617302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-88ce3225-3471-44a5-b52c-9494349d2657 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:56.626895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-88ce3225-3471-44a5-b52c-9494349d2657 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1750 microversion: 2.1 time: 0.202165 Oct 20 13:41:56.627763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 462/837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:56 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1750 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:56.633573 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:56.634616 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:56.654717 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:56.655281 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:56.655675 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:56.656744 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:56.657291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:56.657722 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:56.661684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=100 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:56.704800 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:56.705320 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:56.705747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:56.706374 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'fault' on Instance uuid 3d730923-3277-4e78-9365-a95c403e26d8 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:56.767637 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:56.776180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0da8dde7-f72c-4e68-8dde-f382d35d21b6 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1326 microversion: 2.1 time: 0.147309 Oct 20 13:41:56.776903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 463/838] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:56 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:57.112283 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:57.113195 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:57.122439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:57.123619 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:57.124907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:57.126108 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:57.126978 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:57.127417 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:57.285872 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:57.294971 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:57.296659 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:57.298072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e5e80cea-db35-4427-9722-c338e86b0500 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.190264 Oct 20 13:41:57.298844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 464/839] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:57 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:57.653130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b1725453-fbd8-41f0-8c46-764836b03491 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:57.653902 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b1725453-fbd8-41f0-8c46-764836b03491 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:57.656925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:57.661257 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1725453-fbd8-41f0-8c46-764836b03491 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:57.662358 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1725453-fbd8-41f0-8c46-764836b03491 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:57.662864 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1725453-fbd8-41f0-8c46-764836b03491 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:57.664489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1725453-fbd8-41f0-8c46-764836b03491 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:57.665130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1725453-fbd8-41f0-8c46-764836b03491 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:57.666236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1725453-fbd8-41f0-8c46-764836b03491 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:57.830273 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b1725453-fbd8-41f0-8c46-764836b03491 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:57.842979 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b1725453-fbd8-41f0-8c46-764836b03491 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1750 microversion: 2.1 time: 0.194112 Oct 20 13:41:57.843583 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 465/840] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:57 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1750 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:57.851203 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:57.851818 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:57.858059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:57.858595 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:57.859401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:57.860589 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:57.861525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:57.864405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:57.897781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:57.898274 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:57.898722 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:57.899164 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lazy-loading 'fault' on Instance uuid 3d730923-3277-4e78-9365-a95c403e26d8 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:41:57.953235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe56d1d4278c43cd96a39f7f75f373b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747a468811fb478aa6c49b848ccee6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:57.962338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f07aa8d7-a1f5-45f8-87be-31610a51d6d1 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 200 len: 1326 microversion: 2.1 time: 0.115014 Oct 20 13:41:57.963353 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 466/841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:57 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:41:58.074141 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e1308506-5847-4e2c-a619-8561ec83479d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:58.074654 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e1308506-5847-4e2c-a619-8561ec83479d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:58.080927 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1308506-5847-4e2c-a619-8561ec83479d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:58.081415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1308506-5847-4e2c-a619-8561ec83479d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:58.081906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1308506-5847-4e2c-a619-8561ec83479d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:58.083244 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1308506-5847-4e2c-a619-8561ec83479d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:58.083704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1308506-5847-4e2c-a619-8561ec83479d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:58.084128 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1308506-5847-4e2c-a619-8561ec83479d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:58.118624 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e1308506-5847-4e2c-a619-8561ec83479d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/ips" status: 200 len: 149 microversion: 2.1 time: 0.052273 Oct 20 13:41:58.127088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 467/842] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 20 13:41:58 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/ips => generated 149 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:41:58.326353 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:58.327459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:58.335115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:58.335785 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:58.336219 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:58.336923 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:58.337468 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:58.338103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:58.536282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:58.547023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:58.548787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:58.550032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c3db8e39-1e03-485b-8ace-0486794e7939 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.228218 Oct 20 13:41:58.551135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 468/843] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:58 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:41:58.870463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-20fbc93d-1f99-4bf7-9029-a38d65ac5b2e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:58.871094 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-20fbc93d-1f99-4bf7-9029-a38d65ac5b2e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:58.877401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20fbc93d-1f99-4bf7-9029-a38d65ac5b2e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:58.877925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20fbc93d-1f99-4bf7-9029-a38d65ac5b2e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:58.878361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20fbc93d-1f99-4bf7-9029-a38d65ac5b2e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:58.880018 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20fbc93d-1f99-4bf7-9029-a38d65ac5b2e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:58.882344 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20fbc93d-1f99-4bf7-9029-a38d65ac5b2e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:58.882344 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-20fbc93d-1f99-4bf7-9029-a38d65ac5b2e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:59.107865 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-20fbc93d-1f99-4bf7-9029-a38d65ac5b2e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:59.116885 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-20fbc93d-1f99-4bf7-9029-a38d65ac5b2e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1750 microversion: 2.1 time: 0.250542 Oct 20 13:41:59.117672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 469/844] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:58 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1750 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:41:59.122265 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:59.122871 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:59.128542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:59.129086 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:59.129681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:59.130373 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:59.130833 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:59.131267 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:59.145107 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] HTTP exception thrown: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Request method failure captured: Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 HTTP/1.1 Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6uZk5u9C94mQ-NIaXkVtsejJkSwYuh99OauH6-ODZjT3DJORjrbsPQkdSdiC6tHvpHKpDL4mscQSlAQCTNPC5L_GK24Qun-9YS-7QorGoifSoDwT9-clJFUI6V9D7Yf4wTrD4EcgwYqP2AfZPhm5rWQvWWr64qHW21ZgnkjfaluuE Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:41:59.146788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: fe56d1d4278c43cd96a39f7f75f373b8 Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:41:59.148449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '3d730923-3277-4e78-9365-a95c403e26d8'} Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:41:59.149506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:41:59.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:41:59.152481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Returning 404 to user: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:41:59.152481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1230a688-a53e-462e-8fad-20a250e87796 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 404 len: 111 microversion: 2.1 time: 0.029743 Oct 20 13:41:59.152481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 470/845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:41:59 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:41:59.156751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-aced92f2-ace6-489f-858e-993fdd8a40cc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '.version_select at 0x7ffa12e4c160>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:59.176825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-aced92f2-ace6-489f-858e-993fdd8a40cc tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-679910223" status: 202 len: 0 microversion: 2.1 time: 0.023561 Oct 20 13:41:59.177433 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 471/846] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 20 13:41:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-679910223 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:41:59.529354 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1cc86e9e-822c-4a77-b56e-eeda485514a6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc61aac1-8ab3-415e-9dc0-927b31e04f5f"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:41:59.531723 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1cc86e9e-822c-4a77-b56e-eeda485514a6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:59.539315 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1cc86e9e-822c-4a77-b56e-eeda485514a6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:59.539798 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1cc86e9e-822c-4a77-b56e-eeda485514a6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:59.540235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1cc86e9e-822c-4a77-b56e-eeda485514a6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:59.540966 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1cc86e9e-822c-4a77-b56e-eeda485514a6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:59.541419 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1cc86e9e-822c-4a77-b56e-eeda485514a6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:59.541841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1cc86e9e-822c-4a77-b56e-eeda485514a6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:59.810430 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1cc86e9e-822c-4a77-b56e-eeda485514a6 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "POST /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285061 Oct 20 13:41:59.811113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 472/847] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 20 13:41:59 2022] POST /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:41:59.823012 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:41:59.824156 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:41:59.845320 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:59.845967 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:59.846485 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:59.847215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:41:59.848194 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:41:59.848826 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:41:59.988734 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:59.997514 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:59.998736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:41:59.999886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-eb67c9cb-860a-4851-a896-df763053dafe tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.187814 Oct 20 13:42:00.000759 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 473/848] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:41:59 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:42:00.006011 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-488463993", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "networks": [{"uuid": "99a77227-ee8a-4c13-ada4-06d18282aaa9"}]}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:00.062866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.network.neutron [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] validate_networks() for [('99a77227-ee8a-4c13-ada4-06d18282aaa9', None, None, None, None, None)] {{(pid=125448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:42:00.424786 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Flavor limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:42:00.425413 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Image limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:42:00.426346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Flavor pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:42:00.426804 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Image pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:42:00.427217 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:42:00.435795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:00.436271 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:00.436702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:00.437456 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:00.437906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:00.438333 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:00.454852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Getting quotas for project a444b7fa425b4f0ba7833b93607daa25. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:42:00.459268 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Getting quotas for user 69c04718cd82496abbc82e353873e604 and project a444b7fa425b4f0ba7833b93607daa25. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:42:00.470023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Going to run 1 instances... {{(pid=125448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:42:00.472729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:42:00.518574 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ac707a4e-bf26-4560-a5d0-08785e808b91 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516683 Oct 20 13:42:00.525340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 474/849] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:42:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 13:42:00.525340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ad3906f0-a1dd-4962-8ff0-560fe0b47db7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:00.525340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ad3906f0-a1dd-4962-8ff0-560fe0b47db7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:00.531656 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad3906f0-a1dd-4962-8ff0-560fe0b47db7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:00.532141 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad3906f0-a1dd-4962-8ff0-560fe0b47db7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:00.532575 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad3906f0-a1dd-4962-8ff0-560fe0b47db7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:00.533295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad3906f0-a1dd-4962-8ff0-560fe0b47db7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:00.533748 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad3906f0-a1dd-4962-8ff0-560fe0b47db7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:00.534170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ad3906f0-a1dd-4962-8ff0-560fe0b47db7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:00.683639 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ad3906f0-a1dd-4962-8ff0-560fe0b47db7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:00.692921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ad3906f0-a1dd-4962-8ff0-560fe0b47db7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.172145 Oct 20 13:42:00.693553 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 475/850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:00 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:00.697883 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9d0ee12a-f3f2-43e7-828a-e32a6a57e1f0 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:00.698482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9d0ee12a-f3f2-43e7-828a-e32a6a57e1f0 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:00.762933 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9d0ee12a-f3f2-43e7-828a-e32a6a57e1f0 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:00.774191 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9d0ee12a-f3f2-43e7-828a-e32a6a57e1f0 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1213 microversion: 2.1 time: 0.079600 Oct 20 13:42:00.775145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 476/851] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:00 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:01.026627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:01.027341 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:01.033372 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:01.033940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:01.034366 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:01.036684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:01.037354 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:01.037849 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:01.186466 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:01.197339 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:01.199724 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:01.201284 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3414956f-5dfb-4aed-8a4c-6a327a700b04 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.178810 Oct 20 13:42:01.201888 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 477/852] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:01 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:42:01.721515 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d27b8bc7-11ee-41f8-85d8-667a2aac8803 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:01.722926 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d27b8bc7-11ee-41f8-85d8-667a2aac8803 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:01.733353 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d27b8bc7-11ee-41f8-85d8-667a2aac8803 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:01.734024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d27b8bc7-11ee-41f8-85d8-667a2aac8803 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:01.735350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d27b8bc7-11ee-41f8-85d8-667a2aac8803 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:01.736146 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d27b8bc7-11ee-41f8-85d8-667a2aac8803 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:01.736856 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d27b8bc7-11ee-41f8-85d8-667a2aac8803 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:01.738874 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d27b8bc7-11ee-41f8-85d8-667a2aac8803 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:01.973686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d27b8bc7-11ee-41f8-85d8-667a2aac8803 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:01.983153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d27b8bc7-11ee-41f8-85d8-667a2aac8803 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.267545 Oct 20 13:42:01.984965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 478/853] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:01 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:01.990223 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-df2c3ce5-766a-48d7-b2ad-e744b8e7d2a8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:01.990922 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-df2c3ce5-766a-48d7-b2ad-e744b8e7d2a8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:01.997495 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df2c3ce5-766a-48d7-b2ad-e744b8e7d2a8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:01.998066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df2c3ce5-766a-48d7-b2ad-e744b8e7d2a8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:01.998566 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df2c3ce5-766a-48d7-b2ad-e744b8e7d2a8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:01.999439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df2c3ce5-766a-48d7-b2ad-e744b8e7d2a8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:02.000083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df2c3ce5-766a-48d7-b2ad-e744b8e7d2a8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:02.000791 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-df2c3ce5-766a-48d7-b2ad-e744b8e7d2a8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:02.086075 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-df2c3ce5-766a-48d7-b2ad-e744b8e7d2a8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:02.093947 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-df2c3ce5-766a-48d7-b2ad-e744b8e7d2a8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1271 microversion: 2.1 time: 0.107901 Oct 20 13:42:02.094747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 479/854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:01 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:02.153211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:02.155648 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:02.162946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:02.163736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:02.164424 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:02.165218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:02.165769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:02.166167 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:02.181845 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] HTTP exception thrown: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Request method failure captured: Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 HTTP/1.1 Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6uZk5u9C94mQ-NIaXkVtsejJkSwYuh99OauH6-ODZjT3DJORjrbsPQkdSdiC6tHvpHKpDL4mscQSlAQCTNPC5L_GK24Qun-9YS-7QorGoifSoDwT9-clJFUI6V9D7Yf4wTrD4EcgwYqP2AfZPhm5rWQvWWr64qHW21ZgnkjfaluuE Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:02.183527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: fe56d1d4278c43cd96a39f7f75f373b8 Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:42:02.185228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '3d730923-3277-4e78-9365-a95c403e26d8'} Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:02.186135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:42:02.187707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:02.191620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Returning 404 to user: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:02.192556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-66074f3d-0452-4983-aa25-cf0e61c22a5a tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 404 len: 111 microversion: 2.1 time: 0.045286 Oct 20 13:42:02.193349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 480/855] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:42:02 2022] DELETE /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:42:02.201058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:02.201720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 3d730923-3277-4e78-9365-a95c403e26d8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:02.207729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:02.208348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:02.208690 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:02.209604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:02.210096 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:02.210592 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:02.225525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] HTTP exception thrown: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Request method failure captured: Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 HTTP/1.1 Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6uZk5u9C94mQ-NIaXkVtsejJkSwYuh99OauH6-ODZjT3DJORjrbsPQkdSdiC6tHvpHKpDL4mscQSlAQCTNPC5L_GK24Qun-9YS-7QorGoifSoDwT9-clJFUI6V9D7Yf4wTrD4EcgwYqP2AfZPhm5rWQvWWr64qHW21ZgnkjfaluuE Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:02.227233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: fe56d1d4278c43cd96a39f7f75f373b8 Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:42:02.228847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '3d730923-3277-4e78-9365-a95c403e26d8'} Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:02.229765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. Oct 20 13:42:02.231389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:02.234214 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Returning 404 to user: Instance 3d730923-3277-4e78-9365-a95c403e26d8 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:02.234214 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-82793915-9a91-4760-bbcc-0e37f31beb3b tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8" status: 404 len: 111 microversion: 2.1 time: 0.031257 Oct 20 13:42:02.236957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 481/856] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:02 2022] GET /compute/v2.1/servers/3d730923-3277-4e78-9365-a95c403e26d8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:02.244388 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:02.245717 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:02.252063 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:02.252638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:02.254015 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:02.254729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:02.255483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:02.255903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:02.461962 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:02.464322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:02.472709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:02.474671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:02.476160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-370ba8a4-c234-4bdd-b127-0232cf363046 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.236826 Oct 20 13:42:02.476905 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 482/857] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:02 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:42:03.007269 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-248f68c5-5566-4bea-940f-33f80597435c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:03.007894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-248f68c5-5566-4bea-940f-33f80597435c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:03.015116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-248f68c5-5566-4bea-940f-33f80597435c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:03.015586 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-248f68c5-5566-4bea-940f-33f80597435c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:03.016013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-248f68c5-5566-4bea-940f-33f80597435c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:03.016696 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-248f68c5-5566-4bea-940f-33f80597435c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:03.017175 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-248f68c5-5566-4bea-940f-33f80597435c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:03.017591 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-248f68c5-5566-4bea-940f-33f80597435c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:03.236372 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-248f68c5-5566-4bea-940f-33f80597435c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:03.245319 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-248f68c5-5566-4bea-940f-33f80597435c tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.241933 Oct 20 13:42:03.245889 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 483/858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:03 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:03.250235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d53f4de9-bf11-41a7-9a8f-43189e28f955 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:03.250834 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d53f4de9-bf11-41a7-9a8f-43189e28f955 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:03.257197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d53f4de9-bf11-41a7-9a8f-43189e28f955 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:03.257679 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d53f4de9-bf11-41a7-9a8f-43189e28f955 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:03.258444 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d53f4de9-bf11-41a7-9a8f-43189e28f955 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:03.258781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d53f4de9-bf11-41a7-9a8f-43189e28f955 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:03.259225 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d53f4de9-bf11-41a7-9a8f-43189e28f955 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:03.259645 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d53f4de9-bf11-41a7-9a8f-43189e28f955 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:03.768546 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d53f4de9-bf11-41a7-9a8f-43189e28f955 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:03.777335 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d53f4de9-bf11-41a7-9a8f-43189e28f955 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1313 microversion: 2.1 time: 0.530423 Oct 20 13:42:03.777921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 484/859] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:03 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:03.787492 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-6ee086d9-ed29-4d28-afaf-7ecc54364cc0 req-1b94832b-29c4-4eba-aa8e-9e224917d0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da50e4f6-b3c0-48a2-8769-24d3294ac458", "tag": "d6c4e7f9-9db0-4f5c-81a9-06649b0448e7"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:03.792347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6ee086d9-ed29-4d28-afaf-7ecc54364cc0 req-1b94832b-29c4-4eba-aa8e-9e224917d0e6 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:03.792815 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6ee086d9-ed29-4d28-afaf-7ecc54364cc0 req-1b94832b-29c4-4eba-aa8e-9e224917d0e6 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:03.793277 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6ee086d9-ed29-4d28-afaf-7ecc54364cc0 req-1b94832b-29c4-4eba-aa8e-9e224917d0e6 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:03.806369 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-6ee086d9-ed29-4d28-afaf-7ecc54364cc0 req-1b94832b-29c4-4eba-aa8e-9e224917d0e6 service nova] Creating event network-changed:d6c4e7f9-9db0-4f5c-81a9-06649b0448e7 for instance da50e4f6-b3c0-48a2-8769-24d3294ac458 on hv-cinder-86213 Oct 20 13:42:03.811312 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-6ee086d9-ed29-4d28-afaf-7ecc54364cc0 req-1b94832b-29c4-4eba-aa8e-9e224917d0e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032231 Oct 20 13:42:03.811910 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 485/860] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:42:03.818005 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:03.818588 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:03.824890 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:03.825389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:03.825821 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:03.826511 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:03.826963 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:03.827383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:03.843016 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] HTTP exception thrown: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Request method failure captured: Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 HTTP/1.1 Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6uZk5u9C94mQ-NIaXkVtsejJkSwYuh99OauH6-ODZjT3DJORjrbsPQkdSdiC6tHvpHKpDL4mscQSlAQCTNPC5L_GK24Qun-9YS-7QorGoifSoDwT9-clJFUI6V9D7Yf4wTrD4EcgwYqP2AfZPhm5rWQvWWr64qHW21ZgnkjfaluuE Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:03.844709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: fe56d1d4278c43cd96a39f7f75f373b8 Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:42:03.846348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '19146772-f7e2-43d8-b7b3-3c365f024e54'} Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:03.847289 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:42:03.848629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:03.850884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Returning 404 to user: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:03.850884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-12b580ae-98bc-4e7c-a3db-6d266a4b9565 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 404 len: 111 microversion: 2.1 time: 0.032911 Oct 20 13:42:03.850884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 486/861] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:42:03 2022] DELETE /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:03.853423 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:03.854037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:03.870855 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:03.871368 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:03.871981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:03.872765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:03.873367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:03.873863 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.074827 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:04.083083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:04.084523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:04.085698 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cc8ef354-d78a-4592-8a1a-d86abdbd90a2 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.237555 Oct 20 13:42:04.086246 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 487/862] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:03 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:42:04.090592 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:04.091074 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:04.097376 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.097859 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.098297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.099014 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.100347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.101352 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.116280 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] HTTP exception thrown: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Request method failure captured: Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 HTTP/1.1 Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU8cDuTEvrUkYLHTssq9B7DyI31ydZnts91BrczOyc3C46vtoU3jA4gzdFiFnioizWeBXxNen4fsaEflvzzFhr75E2FV8fdePHz0Lxnwf5xcR_4-Y0E-owjBaFOAXhrfNb2Q0csTyhWafKT1-fvjI6orc2LbjfPz2McyEQuiUsuDLn0 Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 32ef0737a3844bfe8f4bc14b09ebc88b Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-TestVolumeBootPattern-1820889015 Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:04.118692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-TestVolumeBootPattern-1820889015 Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 32ef0737a3844bfe8f4bc14b09ebc88b Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-TestVolumeBootPattern-1820889015 Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-TestVolumeBootPattern-1820889015-project Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: c9ac26a28e7b416b9786ddcacea5928e Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-TestVolumeBootPattern-1820889015-project Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:42:04.120587 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '3a95c3c3-dcce-457b-98df-7b6ff3df8680'} Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:04.121832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:42:04.123282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.124719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Returning 404 to user: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:04.124719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ce274958-c7fc-408f-903d-8748508a6648 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 404 len: 111 microversion: 2.1 time: 0.033178 Oct 20 13:42:04.124719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 488/863] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:42:04 2022] DELETE /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:04.127477 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-6fa2b2b0-f961-4132-b525-a59d4a0c97e5 req-2f77c740-6de8-431a-8cf2-0bb77fb97aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34aa5d9-ed42-4cdd-bed0-229455d27cf1", "name": "network-vif-plugged", "status": "completed", "tag": "220d420d-8061-47e0-9323-3ec3344c20c6"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:04.137254 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6fa2b2b0-f961-4132-b525-a59d4a0c97e5 req-2f77c740-6de8-431a-8cf2-0bb77fb97aa2 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.137721 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6fa2b2b0-f961-4132-b525-a59d4a0c97e5 req-2f77c740-6de8-431a-8cf2-0bb77fb97aa2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.138139 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6fa2b2b0-f961-4132-b525-a59d4a0c97e5 req-2f77c740-6de8-431a-8cf2-0bb77fb97aa2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.149224 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-6fa2b2b0-f961-4132-b525-a59d4a0c97e5 req-2f77c740-6de8-431a-8cf2-0bb77fb97aa2 service nova] Creating event network-vif-plugged:220d420d-8061-47e0-9323-3ec3344c20c6 for instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 on hv-cinder-86213 Oct 20 13:42:04.154185 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-6fa2b2b0-f961-4132-b525-a59d4a0c97e5 req-2f77c740-6de8-431a-8cf2-0bb77fb97aa2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032257 Oct 20 13:42:04.154753 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 489/864] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:42:04.161395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:04.162126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] [instance: 19146772-f7e2-43d8-b7b3-3c365f024e54] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:04.168048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.168457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.168906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.169584 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.170030 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.170446 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.184200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] HTTP exception thrown: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Request method failure captured: Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 HTTP/1.1 Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6uZk5u9C94mQ-NIaXkVtsejJkSwYuh99OauH6-ODZjT3DJORjrbsPQkdSdiC6tHvpHKpDL4mscQSlAQCTNPC5L_GK24Qun-9YS-7QorGoifSoDwT9-clJFUI6V9D7Yf4wTrD4EcgwYqP2AfZPhm5rWQvWWr64qHW21ZgnkjfaluuE Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:04.185948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_747a468811fb478aa6c49b848ccee6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 747a468811fb478aa6c49b848ccee6d0 Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1365418227 Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: fe56d1d4278c43cd96a39f7f75f373b8 Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeTestJSON-1365418227-project Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:42:04.187482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '19146772-f7e2-43d8-b7b3-3c365f024e54'} Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:04.188375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. Oct 20 13:42:04.190221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.191494 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] Returning 404 to user: Instance 19146772-f7e2-43d8-b7b3-3c365f024e54 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:04.191494 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a235b02f-229c-48ae-8f06-37116a0e2c66 tempest-AttachVolumeTestJSON-1365418227 tempest-AttachVolumeTestJSON-1365418227-project] 10.222.0.23 "GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54" status: 404 len: 111 microversion: 2.1 time: 0.031580 Oct 20 13:42:04.191494 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 490/865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:04 2022] GET /compute/v2.1/servers/19146772-f7e2-43d8-b7b3-3c365f024e54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:04.192428 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:04.193118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] [instance: 3a95c3c3-dcce-457b-98df-7b6ff3df8680] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:04.199220 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.199942 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.200110 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.200789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.201262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.201676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.215547 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] HTTP exception thrown: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Request method failure captured: Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 HTTP/1.1 Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU8cDuTEvrUkYLHTssq9B7DyI31ydZnts91BrczOyc3C46vtoU3jA4gzdFiFnioizWeBXxNen4fsaEflvzzFhr75E2FV8fdePHz0Lxnwf5xcR_4-Y0E-owjBaFOAXhrfNb2Q0csTyhWafKT1-fvjI6orc2LbjfPz2McyEQuiUsuDLn0 Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 32ef0737a3844bfe8f4bc14b09ebc88b Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-TestVolumeBootPattern-1820889015 Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:04.217101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_32ef0737a3844bfe8f4bc14b09ebc88b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-TestVolumeBootPattern-1820889015 Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 32ef0737a3844bfe8f4bc14b09ebc88b Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-TestVolumeBootPattern-1820889015 Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-TestVolumeBootPattern-1820889015-project Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: c9ac26a28e7b416b9786ddcacea5928e Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-TestVolumeBootPattern-1820889015-project Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:42:04.218704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '3a95c3c3-dcce-457b-98df-7b6ff3df8680'} Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:04.219556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. Oct 20 13:42:04.221090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:04.223113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Returning 404 to user: Instance 3a95c3c3-dcce-457b-98df-7b6ff3df8680 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:04.223113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-dc7c0dc6-c5e7-4dae-8a03-3addae2d8de7 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680" status: 404 len: 111 microversion: 2.1 time: 0.029736 Oct 20 13:42:04.223113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 491/866] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:04 2022] GET /compute/v2.1/servers/3a95c3c3-dcce-457b-98df-7b6ff3df8680 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:04.270652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c0c9ae02-4535-4401-93ad-b7c8fbd8c671 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:04.271216 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c0c9ae02-4535-4401-93ad-b7c8fbd8c671 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:04.278177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c0c9ae02-4535-4401-93ad-b7c8fbd8c671 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.278731 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c0c9ae02-4535-4401-93ad-b7c8fbd8c671 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.279327 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c0c9ae02-4535-4401-93ad-b7c8fbd8c671 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.280087 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c0c9ae02-4535-4401-93ad-b7c8fbd8c671 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.280702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c0c9ae02-4535-4401-93ad-b7c8fbd8c671 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.281282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c0c9ae02-4535-4401-93ad-b7c8fbd8c671 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.430017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c0c9ae02-4535-4401-93ad-b7c8fbd8c671 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:04.438194 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c0c9ae02-4535-4401-93ad-b7c8fbd8c671 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.172450 Oct 20 13:42:04.438760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 492/867] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:04 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:04.799657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cac8e5fa-5231-4bd0-aff3-e3f283ea4274 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:04.800391 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cac8e5fa-5231-4bd0-aff3-e3f283ea4274 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:04.806818 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cac8e5fa-5231-4bd0-aff3-e3f283ea4274 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.807295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cac8e5fa-5231-4bd0-aff3-e3f283ea4274 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.807776 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cac8e5fa-5231-4bd0-aff3-e3f283ea4274 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.808489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cac8e5fa-5231-4bd0-aff3-e3f283ea4274 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:04.808961 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cac8e5fa-5231-4bd0-aff3-e3f283ea4274 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:04.809394 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cac8e5fa-5231-4bd0-aff3-e3f283ea4274 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:04.945067 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cac8e5fa-5231-4bd0-aff3-e3f283ea4274 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:04.952747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cac8e5fa-5231-4bd0-aff3-e3f283ea4274 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1313 microversion: 2.1 time: 0.157052 Oct 20 13:42:04.953359 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 493/868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:04 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:05.115139 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:05.116684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:05.124635 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:05.125153 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:05.125589 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:05.126313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:05.126764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:05.127784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:05.521076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:05.533154 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:05.536389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:05.537960 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9ada22cf-2b97-4070-8d58-101df2dc855d tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.427761 Oct 20 13:42:05.538881 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 494/869] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:05 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:42:05.552926 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0e65460c-b05d-43fe-9f63-85073fa254fa tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:05.552926 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0e65460c-b05d-43fe-9f63-85073fa254fa tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:05.564265 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e65460c-b05d-43fe-9f63-85073fa254fa tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:05.565054 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e65460c-b05d-43fe-9f63-85073fa254fa tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:05.566489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e65460c-b05d-43fe-9f63-85073fa254fa tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:05.567908 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e65460c-b05d-43fe-9f63-85073fa254fa tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:05.568375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e65460c-b05d-43fe-9f63-85073fa254fa tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:05.568807 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0e65460c-b05d-43fe-9f63-85073fa254fa tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:05.796456 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0e65460c-b05d-43fe-9f63-85073fa254fa tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:05.806443 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0e65460c-b05d-43fe-9f63-85073fa254fa tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.266401 Oct 20 13:42:05.807838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 495/870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:05 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:05.848628 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a3cf607a-eb8f-435a-bef4-64fc8c63dbe3 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] Calling method '.version_select at 0x7ffa12ceab80>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:05.920544 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a3cf607a-eb8f-435a-bef4-64fc8c63dbe3 tempest-TestVolumeBootPattern-1820889015 tempest-TestVolumeBootPattern-1820889015-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1334420547" status: 202 len: 0 microversion: 2.1 time: 0.077796 Oct 20 13:42:05.928989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 496/871] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 20 13:42:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1334420547 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:42:05.977123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7f24a215-d8b7-4982-bbfb-5616e14dfd46 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:05.978076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7f24a215-d8b7-4982-bbfb-5616e14dfd46 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:05.996694 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f24a215-d8b7-4982-bbfb-5616e14dfd46 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:05.997542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f24a215-d8b7-4982-bbfb-5616e14dfd46 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:05.998196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f24a215-d8b7-4982-bbfb-5616e14dfd46 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:05.999288 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f24a215-d8b7-4982-bbfb-5616e14dfd46 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:05.999893 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f24a215-d8b7-4982-bbfb-5616e14dfd46 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:06.000756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7f24a215-d8b7-4982-bbfb-5616e14dfd46 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:06.223436 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7f24a215-d8b7-4982-bbfb-5616e14dfd46 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:06.233007 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7f24a215-d8b7-4982-bbfb-5616e14dfd46 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1313 microversion: 2.1 time: 0.259971 Oct 20 13:42:06.233964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 497/872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:05 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:06.566684 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:06.567483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:06.573543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:06.574030 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:06.574492 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:06.575380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:06.575831 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:06.576253 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:06.721836 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:06.730933 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:06.732654 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:06.733975 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a3b4ceaf-03ca-46c6-a6dd-a9f5ca16d5ae tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.171916 Oct 20 13:42:06.734725 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 498/873] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:06 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:42:06.834567 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1eee13c7-11ec-4377-ad08-12500ff9da47 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:06.836646 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1eee13c7-11ec-4377-ad08-12500ff9da47 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:06.844816 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1eee13c7-11ec-4377-ad08-12500ff9da47 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:06.845512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1eee13c7-11ec-4377-ad08-12500ff9da47 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:06.846817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1eee13c7-11ec-4377-ad08-12500ff9da47 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:06.847777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1eee13c7-11ec-4377-ad08-12500ff9da47 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:06.848331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1eee13c7-11ec-4377-ad08-12500ff9da47 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:06.848853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1eee13c7-11ec-4377-ad08-12500ff9da47 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:07.073360 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1eee13c7-11ec-4377-ad08-12500ff9da47 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:07.082747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1eee13c7-11ec-4377-ad08-12500ff9da47 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.253145 Oct 20 13:42:07.085426 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 499/874] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:06 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:07.256892 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8f1a91f7-b658-4504-b987-d12099be1dd5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:07.257673 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8f1a91f7-b658-4504-b987-d12099be1dd5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:07.266034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f1a91f7-b658-4504-b987-d12099be1dd5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:07.266982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f1a91f7-b658-4504-b987-d12099be1dd5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:07.267489 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f1a91f7-b658-4504-b987-d12099be1dd5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:07.268262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f1a91f7-b658-4504-b987-d12099be1dd5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:07.268837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f1a91f7-b658-4504-b987-d12099be1dd5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:07.269447 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f1a91f7-b658-4504-b987-d12099be1dd5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:07.449958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8f1a91f7-b658-4504-b987-d12099be1dd5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:07.463031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8f1a91f7-b658-4504-b987-d12099be1dd5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1313 microversion: 2.1 time: 0.211083 Oct 20 13:42:07.463629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 500/875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:07 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:07.664392 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-349c1b48-f5ab-47f5-b56c-6c39524c8d2c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:07.665188 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-349c1b48-f5ab-47f5-b56c-6c39524c8d2c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:07.671163 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-349c1b48-f5ab-47f5-b56c-6c39524c8d2c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:07.671652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-349c1b48-f5ab-47f5-b56c-6c39524c8d2c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:07.672087 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-349c1b48-f5ab-47f5-b56c-6c39524c8d2c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:07.672786 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-349c1b48-f5ab-47f5-b56c-6c39524c8d2c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:07.673301 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-349c1b48-f5ab-47f5-b56c-6c39524c8d2c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:07.673724 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-349c1b48-f5ab-47f5-b56c-6c39524c8d2c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:07.859375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-349c1b48-f5ab-47f5-b56c-6c39524c8d2c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lazy-loading 'services' on Instance uuid 09046678-4ab5-4b0a-af64-386fcb5735c5 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:42:08.007604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-349c1b48-f5ab-47f5-b56c-6c39524c8d2c tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/os-volume_attachments/fc61aac1-8ab3-415e-9dc0-927b31e04f5f" status: 202 len: 0 microversion: 2.1 time: 0.347290 Oct 20 13:42:08.010007 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 501/876] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:42:07 2022] DELETE /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/os-volume_attachments/fc61aac1-8ab3-415e-9dc0-927b31e04f5f => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:42:08.025314 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:08.026166 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:08.046104 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:08.046443 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:08.051514 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:08.052271 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:08.052758 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:08.053196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:08.419916 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:08.432911 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:08.436241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:08.438561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-dad25f77-ac80-4cba-b40a-1a63f30dcb15 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1729 microversion: 2.20 time: 0.420920 Oct 20 13:42:08.439471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 502/877] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:08 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1729 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:42:08.444922 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-816ca115-c149-4d10-a72e-6c13ace1643d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:08.447736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-816ca115-c149-4d10-a72e-6c13ace1643d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:08.454991 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-816ca115-c149-4d10-a72e-6c13ace1643d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:08.455491 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-816ca115-c149-4d10-a72e-6c13ace1643d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:08.455931 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-816ca115-c149-4d10-a72e-6c13ace1643d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:08.456671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-816ca115-c149-4d10-a72e-6c13ace1643d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:08.457161 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-816ca115-c149-4d10-a72e-6c13ace1643d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:08.457598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-816ca115-c149-4d10-a72e-6c13ace1643d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:08.495008 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:08.526544 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-816ca115-c149-4d10-a72e-6c13ace1643d tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085836 Oct 20 13:42:08.529232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 503/878] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:42:08 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:42:08.537605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-59a8a666-ea0d-41f0-abe0-d7fb5320158b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:08.541268 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-59a8a666-ea0d-41f0-abe0-d7fb5320158b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:08.544747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:08.549618 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a8a666-ea0d-41f0-abe0-d7fb5320158b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:08.550950 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a8a666-ea0d-41f0-abe0-d7fb5320158b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:08.551752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a8a666-ea0d-41f0-abe0-d7fb5320158b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:08.552695 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a8a666-ea0d-41f0-abe0-d7fb5320158b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:08.553530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a8a666-ea0d-41f0-abe0-d7fb5320158b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:08.554107 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-59a8a666-ea0d-41f0-abe0-d7fb5320158b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:08.939610 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-59a8a666-ea0d-41f0-abe0-d7fb5320158b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:08.948526 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-59a8a666-ea0d-41f0-abe0-d7fb5320158b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.417849 Oct 20 13:42:08.953710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 504/879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:08 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:08.967510 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c7caa091-275f-4b65-b46a-8ed4a478297b tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:08.974322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c7caa091-275f-4b65-b46a-8ed4a478297b tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:08.999499 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7caa091-275f-4b65-b46a-8ed4a478297b tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:09.000017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7caa091-275f-4b65-b46a-8ed4a478297b tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:09.000467 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7caa091-275f-4b65-b46a-8ed4a478297b tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:09.009760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7caa091-275f-4b65-b46a-8ed4a478297b tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:09.010750 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7caa091-275f-4b65-b46a-8ed4a478297b tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:09.015575 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c7caa091-275f-4b65-b46a-8ed4a478297b tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:09.281924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c7caa091-275f-4b65-b46a-8ed4a478297b tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:09.293653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c7caa091-275f-4b65-b46a-8ed4a478297b tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1313 microversion: 2.1 time: 0.338482 Oct 20 13:42:09.294761 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 505/880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:08 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:09.469019 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:09.469630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:09.477725 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:09.478207 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:09.478825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:09.479811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:09.480420 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:09.481034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:09.687152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:09.702183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:09.706386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:09.708501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-6ca93407-96f0-4469-a7e5-5e253b00fbb9 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1716 microversion: 2.20 time: 0.245392 Oct 20 13:42:09.711292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 506/881] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:09 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1716 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:42:09.739304 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1333a034-47ad-440c-83ac-eda4f218cf64 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:09.742158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1333a034-47ad-440c-83ac-eda4f218cf64 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:09.750940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1333a034-47ad-440c-83ac-eda4f218cf64 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:09.751706 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1333a034-47ad-440c-83ac-eda4f218cf64 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:09.752796 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1333a034-47ad-440c-83ac-eda4f218cf64 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:09.754754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1333a034-47ad-440c-83ac-eda4f218cf64 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:09.755381 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1333a034-47ad-440c-83ac-eda4f218cf64 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:09.756128 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1333a034-47ad-440c-83ac-eda4f218cf64 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:09.811031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1333a034-47ad-440c-83ac-eda4f218cf64 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084672 Oct 20 13:42:09.812217 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 507/882] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:42:09 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 13:42:09.910536 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-76e5c2e7-d835-4cb7-adf3-d0d6330d3ef9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:09.911236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-76e5c2e7-d835-4cb7-adf3-d0d6330d3ef9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:09.918210 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-76e5c2e7-d835-4cb7-adf3-d0d6330d3ef9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:09.918781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-76e5c2e7-d835-4cb7-adf3-d0d6330d3ef9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:09.919294 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-76e5c2e7-d835-4cb7-adf3-d0d6330d3ef9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:09.920211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-76e5c2e7-d835-4cb7-adf3-d0d6330d3ef9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:09.920856 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-76e5c2e7-d835-4cb7-adf3-d0d6330d3ef9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:09.927705 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-76e5c2e7-d835-4cb7-adf3-d0d6330d3ef9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:09.982105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-76e5c2e7-d835-4cb7-adf3-d0d6330d3ef9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:42:10.172895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-76e5c2e7-d835-4cb7-adf3-d0d6330d3ef9 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 204 len: 0 microversion: 2.1 time: 0.266464 Oct 20 13:42:10.173439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 508/883] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:42:09 2022] DELETE /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 20 13:42:10.190018 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b193b6e8-c15f-41e4-8f65-012c7b8b7507 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:10.190786 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b193b6e8-c15f-41e4-8f65-012c7b8b7507 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:10.204401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b193b6e8-c15f-41e4-8f65-012c7b8b7507 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:10.205007 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b193b6e8-c15f-41e4-8f65-012c7b8b7507 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:10.205449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b193b6e8-c15f-41e4-8f65-012c7b8b7507 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:10.206338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b193b6e8-c15f-41e4-8f65-012c7b8b7507 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:10.206970 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b193b6e8-c15f-41e4-8f65-012c7b8b7507 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:10.207407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b193b6e8-c15f-41e4-8f65-012c7b8b7507 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:10.446288 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:10.495364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b193b6e8-c15f-41e4-8f65-012c7b8b7507 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:10.509559 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b193b6e8-c15f-41e4-8f65-012c7b8b7507 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.333084 Oct 20 13:42:10.513034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 509/884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:10 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:10.528992 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-f526e673-9204-4ce8-a631-1396e43fc6be req-f5daa423-00f5-40cf-8380-99ea8b37c21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da50e4f6-b3c0-48a2-8769-24d3294ac458", "name": "network-vif-plugged", "status": "completed", "tag": "d6c4e7f9-9db0-4f5c-81a9-06649b0448e7"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:10.538796 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f526e673-9204-4ce8-a631-1396e43fc6be req-f5daa423-00f5-40cf-8380-99ea8b37c21e service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:10.539488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f526e673-9204-4ce8-a631-1396e43fc6be req-f5daa423-00f5-40cf-8380-99ea8b37c21e service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:10.539913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-f526e673-9204-4ce8-a631-1396e43fc6be req-f5daa423-00f5-40cf-8380-99ea8b37c21e service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:10.551704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-f526e673-9204-4ce8-a631-1396e43fc6be req-f5daa423-00f5-40cf-8380-99ea8b37c21e service nova] Creating event network-vif-plugged:d6c4e7f9-9db0-4f5c-81a9-06649b0448e7 for instance da50e4f6-b3c0-48a2-8769-24d3294ac458 on hv-cinder-86213 Oct 20 13:42:10.556514 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-f526e673-9204-4ce8-a631-1396e43fc6be req-f5daa423-00f5-40cf-8380-99ea8b37c21e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042120 Oct 20 13:42:10.557139 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 510/885] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:42:10.563296 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3378126e-3285-48f9-be30-3095b25b6f6e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:10.563993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3378126e-3285-48f9-be30-3095b25b6f6e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:10.570403 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3378126e-3285-48f9-be30-3095b25b6f6e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:10.570824 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3378126e-3285-48f9-be30-3095b25b6f6e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:10.571254 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3378126e-3285-48f9-be30-3095b25b6f6e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:10.571940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3378126e-3285-48f9-be30-3095b25b6f6e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:10.572385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3378126e-3285-48f9-be30-3095b25b6f6e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:10.572804 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3378126e-3285-48f9-be30-3095b25b6f6e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:10.759988 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3378126e-3285-48f9-be30-3095b25b6f6e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:10.768105 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=8 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:10.771679 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3378126e-3285-48f9-be30-3095b25b6f6e tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1680 microversion: 2.1 time: 0.213211 Oct 20 13:42:10.773438 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 511/886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:10 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:10.805735 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d7a29ecc-8e92-4f8a-a622-dbe711f1ef60 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:10.806633 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d7a29ecc-8e92-4f8a-a622-dbe711f1ef60 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:10.813649 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d7a29ecc-8e92-4f8a-a622-dbe711f1ef60 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:10.823273 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d7a29ecc-8e92-4f8a-a622-dbe711f1ef60 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:10.823973 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d7a29ecc-8e92-4f8a-a622-dbe711f1ef60 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:10.824904 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d7a29ecc-8e92-4f8a-a622-dbe711f1ef60 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:10.825631 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d7a29ecc-8e92-4f8a-a622-dbe711f1ef60 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:10.826248 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d7a29ecc-8e92-4f8a-a622-dbe711f1ef60 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:11.009020 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d7a29ecc-8e92-4f8a-a622-dbe711f1ef60 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:11.019533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d7a29ecc-8e92-4f8a-a622-dbe711f1ef60 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1313 microversion: 2.1 time: 0.226903 Oct 20 13:42:11.020558 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 512/887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:10 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:11.547686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b52fc572-7ba0-4235-8f21-658f502465da tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:11.549335 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b52fc572-7ba0-4235-8f21-658f502465da tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:11.570324 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b52fc572-7ba0-4235-8f21-658f502465da tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:11.571263 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b52fc572-7ba0-4235-8f21-658f502465da tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:11.573591 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b52fc572-7ba0-4235-8f21-658f502465da tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:11.575104 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b52fc572-7ba0-4235-8f21-658f502465da tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:11.578012 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b52fc572-7ba0-4235-8f21-658f502465da tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:11.578496 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b52fc572-7ba0-4235-8f21-658f502465da tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:12.316811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b52fc572-7ba0-4235-8f21-658f502465da tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:12.333571 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b52fc572-7ba0-4235-8f21-658f502465da tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.797194 Oct 20 13:42:12.335151 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 513/888] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:11 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:12.356551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-317c1b9a-b798-4b79-86f2-a5d1cbdc64b1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:12.361184 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-317c1b9a-b798-4b79-86f2-a5d1cbdc64b1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:12.371337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-317c1b9a-b798-4b79-86f2-a5d1cbdc64b1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:12.372971 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-317c1b9a-b798-4b79-86f2-a5d1cbdc64b1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:12.374947 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-317c1b9a-b798-4b79-86f2-a5d1cbdc64b1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:12.376059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-317c1b9a-b798-4b79-86f2-a5d1cbdc64b1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:12.376751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-317c1b9a-b798-4b79-86f2-a5d1cbdc64b1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:12.377280 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-317c1b9a-b798-4b79-86f2-a5d1cbdc64b1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:12.804700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-317c1b9a-b798-4b79-86f2-a5d1cbdc64b1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:12.814864 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-317c1b9a-b798-4b79-86f2-a5d1cbdc64b1 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1680 microversion: 2.1 time: 0.477802 Oct 20 13:42:12.816128 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 514/889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:12 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1680 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:12.821710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-37ed844c-5a3e-425e-8dd8-6b4b4bdde8ef tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:12.822481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-37ed844c-5a3e-425e-8dd8-6b4b4bdde8ef tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:12.828825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37ed844c-5a3e-425e-8dd8-6b4b4bdde8ef tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:12.829545 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37ed844c-5a3e-425e-8dd8-6b4b4bdde8ef tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:12.830140 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37ed844c-5a3e-425e-8dd8-6b4b4bdde8ef tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:12.831512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37ed844c-5a3e-425e-8dd8-6b4b4bdde8ef tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:12.832136 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37ed844c-5a3e-425e-8dd8-6b4b4bdde8ef tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:12.832702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-37ed844c-5a3e-425e-8dd8-6b4b4bdde8ef tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:13.199880 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-37ed844c-5a3e-425e-8dd8-6b4b4bdde8ef tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:13.217290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-37ed844c-5a3e-425e-8dd8-6b4b4bdde8ef tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1313 microversion: 2.1 time: 0.399928 Oct 20 13:42:13.217880 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 515/890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:12 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:13.360351 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-91c590eb-75eb-4021-a799-cfd2cef0ab06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:13.361509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-91c590eb-75eb-4021-a799-cfd2cef0ab06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:13.369468 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-91c590eb-75eb-4021-a799-cfd2cef0ab06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:13.370273 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-91c590eb-75eb-4021-a799-cfd2cef0ab06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:13.370891 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-91c590eb-75eb-4021-a799-cfd2cef0ab06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:13.371795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-91c590eb-75eb-4021-a799-cfd2cef0ab06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:13.372434 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-91c590eb-75eb-4021-a799-cfd2cef0ab06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:13.373094 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-91c590eb-75eb-4021-a799-cfd2cef0ab06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:13.741746 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-91c590eb-75eb-4021-a799-cfd2cef0ab06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:13.760947 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-91c590eb-75eb-4021-a799-cfd2cef0ab06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.403113 Oct 20 13:42:13.764182 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 516/891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:13 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:13.841652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e2a91c70-bbc6-4e89-95ae-2e35572eafb5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:13.842292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e2a91c70-bbc6-4e89-95ae-2e35572eafb5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:13.849186 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e2a91c70-bbc6-4e89-95ae-2e35572eafb5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:13.849751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e2a91c70-bbc6-4e89-95ae-2e35572eafb5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:13.850332 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e2a91c70-bbc6-4e89-95ae-2e35572eafb5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:13.851049 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e2a91c70-bbc6-4e89-95ae-2e35572eafb5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:13.851610 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e2a91c70-bbc6-4e89-95ae-2e35572eafb5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:13.852121 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e2a91c70-bbc6-4e89-95ae-2e35572eafb5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:14.017615 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e2a91c70-bbc6-4e89-95ae-2e35572eafb5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144e9801ac1f470083d11647652ccdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b215cb88123a4851932dbf7dfa88f709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:14.032670 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e2a91c70-bbc6-4e89-95ae-2e35572eafb5 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 200 len: 1613 microversion: 2.1 time: 0.196156 Oct 20 13:42:14.035409 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 517/892] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:13 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 1613 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:14.041819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-7103a348-01a7-4ccf-a471-843e12c76231 req-caebedbf-e386-4ca9-be62-51ed9ae162ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09046678-4ab5-4b0a-af64-386fcb5735c5", "name": "network-vif-deleted", "tag": "56c0f2ff-4b2b-47e3-8bfd-ca7966abf40e"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:14.085600 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7103a348-01a7-4ccf-a471-843e12c76231 req-caebedbf-e386-4ca9-be62-51ed9ae162ca service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:14.086216 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7103a348-01a7-4ccf-a471-843e12c76231 req-caebedbf-e386-4ca9-be62-51ed9ae162ca service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:14.086653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7103a348-01a7-4ccf-a471-843e12c76231 req-caebedbf-e386-4ca9-be62-51ed9ae162ca service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:14.102771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-7103a348-01a7-4ccf-a471-843e12c76231 req-caebedbf-e386-4ca9-be62-51ed9ae162ca service nova] Creating event network-vif-deleted:56c0f2ff-4b2b-47e3-8bfd-ca7966abf40e for instance 09046678-4ab5-4b0a-af64-386fcb5735c5 on hv-cinder-86213 Oct 20 13:42:14.109620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-7103a348-01a7-4ccf-a471-843e12c76231 req-caebedbf-e386-4ca9-be62-51ed9ae162ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071027 Oct 20 13:42:14.113939 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 518/893] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:42:14.242108 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ce2a0e6b-0d06-478f-bda0-5f990b653590 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:14.245998 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ce2a0e6b-0d06-478f-bda0-5f990b653590 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:14.253480 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce2a0e6b-0d06-478f-bda0-5f990b653590 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:14.254319 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce2a0e6b-0d06-478f-bda0-5f990b653590 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:14.255125 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce2a0e6b-0d06-478f-bda0-5f990b653590 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:14.256040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce2a0e6b-0d06-478f-bda0-5f990b653590 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:14.256506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce2a0e6b-0d06-478f-bda0-5f990b653590 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:14.258870 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ce2a0e6b-0d06-478f-bda0-5f990b653590 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:14.650857 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-ce2a0e6b-0d06-478f-bda0-5f990b653590 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:14.658734 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ce2a0e6b-0d06-478f-bda0-5f990b653590 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1498 microversion: 2.1 time: 0.422144 Oct 20 13:42:14.673649 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 519/894] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:14 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1498 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:14.786070 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c576c8a3-6dff-4d44-aa82-58a8ea7123d1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:14.786705 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c576c8a3-6dff-4d44-aa82-58a8ea7123d1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:14.802380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c576c8a3-6dff-4d44-aa82-58a8ea7123d1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:14.803564 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c576c8a3-6dff-4d44-aa82-58a8ea7123d1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:14.804198 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c576c8a3-6dff-4d44-aa82-58a8ea7123d1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:14.805689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c576c8a3-6dff-4d44-aa82-58a8ea7123d1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:14.806309 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c576c8a3-6dff-4d44-aa82-58a8ea7123d1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:14.806893 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c576c8a3-6dff-4d44-aa82-58a8ea7123d1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:14.810333 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:15.098937 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c576c8a3-6dff-4d44-aa82-58a8ea7123d1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:15.110072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c576c8a3-6dff-4d44-aa82-58a8ea7123d1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.329048 Oct 20 13:42:15.110662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 520/895] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:14 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:15.136761 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:15.137694 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:15.167931 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:15.169790 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:15.172494 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:15.173655 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:15.174200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:15.174784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:15.191612 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 HTTP/1.1 Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:15.194061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:15.195986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '09046678-4ab5-4b0a-af64-386fcb5735c5'} Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:15.197233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:15.198738 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:15.202618 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:15.203728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-a9aec47b-2594-4cb2-b85d-e8288f58ef45 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 404 len: 111 microversion: 2.1 time: 0.077785 Oct 20 13:42:15.204606 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 521/896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:15 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:15.216356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-08a3c66b-b591-45d3-b033-172e431c7309 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '.version_select at 0x7ffa12cea8b0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:15.246664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-08a3c66b-b591-45d3-b033-172e431c7309 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081126730" status: 202 len: 0 microversion: 2.1 time: 0.035655 Oct 20 13:42:15.251486 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 522/897] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 20 13:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081126730 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:42:15.275036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c87c6806-e4db-4e0b-9935-f44b72aa2b1a tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:15.276144 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c87c6806-e4db-4e0b-9935-f44b72aa2b1a tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:15.291652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c87c6806-e4db-4e0b-9935-f44b72aa2b1a tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:15.293817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c87c6806-e4db-4e0b-9935-f44b72aa2b1a tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:15.294261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c87c6806-e4db-4e0b-9935-f44b72aa2b1a tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:15.295017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c87c6806-e4db-4e0b-9935-f44b72aa2b1a tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:15.295475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c87c6806-e4db-4e0b-9935-f44b72aa2b1a tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:15.295897 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c87c6806-e4db-4e0b-9935-f44b72aa2b1a tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:15.333288 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c87c6806-e4db-4e0b-9935-f44b72aa2b1a tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:42:15.463965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c87c6806-e4db-4e0b-9935-f44b72aa2b1a tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 204 len: 0 microversion: 2.1 time: 0.206794 Oct 20 13:42:15.467277 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 523/898] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:42:15 2022] DELETE /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:42:15.477115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c093cdee-88fa-4370-9470-e263cbab5500 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:15.478277 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c093cdee-88fa-4370-9470-e263cbab5500 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:15.491346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c093cdee-88fa-4370-9470-e263cbab5500 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:15.500439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c093cdee-88fa-4370-9470-e263cbab5500 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:15.501598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c093cdee-88fa-4370-9470-e263cbab5500 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:15.503917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c093cdee-88fa-4370-9470-e263cbab5500 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:15.505628 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c093cdee-88fa-4370-9470-e263cbab5500 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:15.506265 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c093cdee-88fa-4370-9470-e263cbab5500 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:16.084561 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c093cdee-88fa-4370-9470-e263cbab5500 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:16.093792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c093cdee-88fa-4370-9470-e263cbab5500 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1504 microversion: 2.1 time: 0.622428 Oct 20 13:42:16.097274 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 524/899] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:15 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1504 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:16.140300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-bc976559-3f68-444e-b52f-bfd5dd1115e2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:16.141160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-bc976559-3f68-444e-b52f-bfd5dd1115e2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:16.148755 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bc976559-3f68-444e-b52f-bfd5dd1115e2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:16.150260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bc976559-3f68-444e-b52f-bfd5dd1115e2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:16.150949 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bc976559-3f68-444e-b52f-bfd5dd1115e2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:16.151896 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bc976559-3f68-444e-b52f-bfd5dd1115e2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:16.152430 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bc976559-3f68-444e-b52f-bfd5dd1115e2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:16.153008 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bc976559-3f68-444e-b52f-bfd5dd1115e2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:16.569588 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-bc976559-3f68-444e-b52f-bfd5dd1115e2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:16.578904 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-bc976559-3f68-444e-b52f-bfd5dd1115e2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1755 microversion: 2.1 time: 0.444831 Oct 20 13:42:16.590089 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 525/900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:16 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1755 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:17.121061 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f4a7d159-5c30-447c-9fec-ff019ad55471 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:17.121931 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f4a7d159-5c30-447c-9fec-ff019ad55471 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:17.130012 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4a7d159-5c30-447c-9fec-ff019ad55471 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:17.130763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4a7d159-5c30-447c-9fec-ff019ad55471 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:17.131346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4a7d159-5c30-447c-9fec-ff019ad55471 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:17.132131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4a7d159-5c30-447c-9fec-ff019ad55471 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:17.132974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4a7d159-5c30-447c-9fec-ff019ad55471 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:17.133630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4a7d159-5c30-447c-9fec-ff019ad55471 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:17.394657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f4a7d159-5c30-447c-9fec-ff019ad55471 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:17.407825 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f4a7d159-5c30-447c-9fec-ff019ad55471 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1504 microversion: 2.1 time: 0.292229 Oct 20 13:42:17.409302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 526/901] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:17 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:17.604639 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f50e980d-b7df-4bfd-859f-125ac4223ff3 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:17.605232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f50e980d-b7df-4bfd-859f-125ac4223ff3 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:17.618282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f50e980d-b7df-4bfd-859f-125ac4223ff3 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:17.619037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f50e980d-b7df-4bfd-859f-125ac4223ff3 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:17.619689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f50e980d-b7df-4bfd-859f-125ac4223ff3 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:17.620389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f50e980d-b7df-4bfd-859f-125ac4223ff3 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:17.620837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f50e980d-b7df-4bfd-859f-125ac4223ff3 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:17.621313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f50e980d-b7df-4bfd-859f-125ac4223ff3 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:17.954759 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f50e980d-b7df-4bfd-859f-125ac4223ff3 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:17.973807 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f50e980d-b7df-4bfd-859f-125ac4223ff3 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1758 microversion: 2.1 time: 0.373191 Oct 20 13:42:17.994074 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 527/902] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:17 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1758 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:18.028472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-afcbf533-57aa-4385-9332-294b3c2d794d req-f3fc0189-0212-402b-8535-0418e3571d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da50e4f6-b3c0-48a2-8769-24d3294ac458", "name": "network-vif-deleted", "tag": "d6c4e7f9-9db0-4f5c-81a9-06649b0448e7"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:18.046352 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-afcbf533-57aa-4385-9332-294b3c2d794d req-f3fc0189-0212-402b-8535-0418e3571d26 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:18.046848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-afcbf533-57aa-4385-9332-294b3c2d794d req-f3fc0189-0212-402b-8535-0418e3571d26 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:18.047282 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-afcbf533-57aa-4385-9332-294b3c2d794d req-f3fc0189-0212-402b-8535-0418e3571d26 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:18.067097 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-afcbf533-57aa-4385-9332-294b3c2d794d req-f3fc0189-0212-402b-8535-0418e3571d26 service nova] Creating event network-vif-deleted:d6c4e7f9-9db0-4f5c-81a9-06649b0448e7 for instance da50e4f6-b3c0-48a2-8769-24d3294ac458 on hv-cinder-86213 Oct 20 13:42:18.074363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-afcbf533-57aa-4385-9332-294b3c2d794d req-f3fc0189-0212-402b-8535-0418e3571d26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067802 Oct 20 13:42:18.075063 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 528/903] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:42:18.103501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:18.104245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:18.112444 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:18.113302 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:18.114123 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:18.114979 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:18.115578 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:18.116148 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:18.154510 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 HTTP/1.1 Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:18.156482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:18.158100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '09046678-4ab5-4b0a-af64-386fcb5735c5'} Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:18.159013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:18.162095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:18.165350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:18.166433 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ef8d3626-c4c6-4a9e-a40d-9494ca35f379 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 404 len: 111 microversion: 2.1 time: 0.068463 Oct 20 13:42:18.170441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 529/904] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:42:18 2022] DELETE /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:18.178309 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:18.179313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 09046678-4ab5-4b0a-af64-386fcb5735c5] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:18.188419 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:18.189325 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:18.190778 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:18.191937 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:18.194217 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:18.194879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:18.214389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 HTTP/1.1 Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:18.216115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:18.217729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '09046678-4ab5-4b0a-af64-386fcb5735c5'} Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:18.218627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. Oct 20 13:42:18.220027 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:18.222752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance 09046678-4ab5-4b0a-af64-386fcb5735c5 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:18.223793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4ec261dc-09da-4f8d-a1de-171463e1bf21 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5" status: 404 len: 111 microversion: 2.1 time: 0.051794 Oct 20 13:42:18.227829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 530/905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:18 2022] GET /compute/v2.1/servers/09046678-4ab5-4b0a-af64-386fcb5735c5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:18.433595 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:18.435186 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:18.443429 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:18.443922 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:18.444484 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:18.445422 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:18.446346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:18.446924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:18.489477 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:18.489959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:18.490386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:18.490831 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lazy-loading 'fault' on Instance uuid da50e4f6-b3c0-48a2-8769-24d3294ac458 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:42:18.554290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:18.568539 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-95d46a9a-ccd0-4e66-bfb3-0557312a776c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 200 len: 1303 microversion: 2.1 time: 0.140411 Oct 20 13:42:18.573276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 531/906] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:18 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:19.425925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:19.426688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:19.433769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:19.435031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:19.435613 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:19.436467 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:19.437103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:19.437948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:19.454636 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 HTTP/1.1 Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:19.456596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:42:19.458252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '29e3dc4f-68fd-40c3-a6db-6a36405b78b8'} Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:19.459119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:42:19.460440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.462784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:19.463651 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-906f034f-b5b5-4a74-af87-f358f93e8471 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 404 len: 111 microversion: 2.1 time: 0.042704 Oct 20 13:42:19.464533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 532/907] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:42:19 2022] DELETE /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:42:19.473928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:19.474549 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: 29e3dc4f-68fd-40c3-a6db-6a36405b78b8] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:19.481356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:19.482572 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:19.483378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:19.484439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:19.485091 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:19.485790 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:19.507993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 HTTP/1.1 Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:19.511756 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:42:19.513340 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '29e3dc4f-68fd-40c3-a6db-6a36405b78b8'} Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:19.514118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. Oct 20 13:42:19.515297 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.516378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance 29e3dc4f-68fd-40c3-a6db-6a36405b78b8 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:19.516378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e4f23222-3595-4827-85b6-7d1dde6efb37 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8" status: 404 len: 111 microversion: 2.1 time: 0.044401 Oct 20 13:42:19.516378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 533/908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:19 2022] GET /compute/v2.1/servers/29e3dc4f-68fd-40c3-a6db-6a36405b78b8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:42:19.522940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:19.523604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:19.530040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:19.530570 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:19.530954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:19.531661 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:19.532099 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:19.532615 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:19.547717 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 HTTP/1.1 Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:19.549917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:42:19.551299 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'f4fc63ee-55ed-437c-81f4-4d658bf32051'} Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:19.552085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:42:19.553350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.554600 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:19.554600 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ee06de04-e03b-45db-9184-1f5de5d89668 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 404 len: 111 microversion: 2.1 time: 0.033037 Oct 20 13:42:19.554843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 534/909] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:42:19 2022] DELETE /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:19.559874 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:19.560495 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: f4fc63ee-55ed-437c-81f4-4d658bf32051] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:19.568013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:19.568683 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:19.568951 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:19.569662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:19.570112 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:19.570527 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:19.585508 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 HTTP/1.1 Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:19.587080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:42:19.590402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'f4fc63ee-55ed-437c-81f4-4d658bf32051'} Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:19.591416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. Oct 20 13:42:19.592843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.594349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance f4fc63ee-55ed-437c-81f4-4d658bf32051 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:19.594349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-25a72d6f-48ee-454f-a486-5c44240c5a11 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051" status: 404 len: 111 microversion: 2.1 time: 0.032506 Oct 20 13:42:19.594349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 535/910] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:19 2022] GET /compute/v2.1/servers/f4fc63ee-55ed-437c-81f4-4d658bf32051 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:19.597415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:19.598029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: da50e4f6-b3c0-48a2-8769-24d3294ac458] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:19.605689 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:19.606193 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:19.606627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:19.607336 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:19.607844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:19.608196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:19.625062 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] HTTP exception thrown: Instance da50e4f6-b3c0-48a2-8769-24d3294ac458 could not be found. Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Request method failure captured: Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 HTTP/1.1 Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUVAmZS-EtNqWZSoGtemOblEeLmWfw69Egka2jiqdXQYkAMmRuiK4CvXFNr3Q08k9Sy65FKOZXPnFsUufBpH8tgUUD0j5daYZyYemlD-YUDHz0Ot5eRt7_fVz9wIrv0NbEyDtfqqJigIl9NuRcVRy_QtD7wUU8SoaBCP-SSgNypJ51hU Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: a444b7fa425b4f0ba7833b93607daa25 Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesActionsTest-1331623610 Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:19.626658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a444b7fa425b4f0ba7833b93607daa25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a444b7fa425b4f0ba7833b93607daa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a444b7fa425b4f0ba7833b93607daa25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a444b7fa425b4f0ba7833b93607daa25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesActionsTest-1331623610 Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: a444b7fa425b4f0ba7833b93607daa25 Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesActionsTest-1331623610 Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesActionsTest-1331623610-project Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 69c04718cd82496abbc82e353873e604 Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesActionsTest-1331623610-project Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance da50e4f6-b3c0-48a2-8769-24d3294ac458 could not be found. Oct 20 13:42:19.628894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'da50e4f6-b3c0-48a2-8769-24d3294ac458'} Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da50e4f6-b3c0-48a2-8769-24d3294ac458 could not be found. Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:19.629787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da50e4f6-b3c0-48a2-8769-24d3294ac458 could not be found. Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da50e4f6-b3c0-48a2-8769-24d3294ac458 could not be found. Oct 20 13:42:19.630996 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:19.632113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Returning 404 to user: Instance da50e4f6-b3c0-48a2-8769-24d3294ac458 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:19.632113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-dc27cffe-9641-4467-95a1-04137732cf69 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458" status: 404 len: 111 microversion: 2.1 time: 0.035145 Oct 20 13:42:19.632113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 536/911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:19 2022] GET /compute/v2.1/servers/da50e4f6-b3c0-48a2-8769-24d3294ac458 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:19.757344 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1122849820", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452", "networks": [{"uuid": "99a77227-ee8a-4c13-ada4-06d18282aaa9"}]}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:19.824172 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.network.neutron [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] validate_networks() for [('99a77227-ee8a-4c13-ada4-06d18282aaa9', None, None, None, None, None)] {{(pid=125448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:42:20.185617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Flavor limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:42:20.186034 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Image limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:42:20.186565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Flavor pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:42:20.187019 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Image pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:42:20.187513 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:42:20.198405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:20.198885 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:20.199634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:20.200539 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:20.201154 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:20.201724 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:20.220337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Getting quotas for project a444b7fa425b4f0ba7833b93607daa25. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:42:20.224534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Getting quotas for user 69c04718cd82496abbc82e353873e604 and project a444b7fa425b4f0ba7833b93607daa25. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:42:20.236094 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Going to run 1 instances... {{(pid=125448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:42:20.238766 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:42:20.288494 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4735551d-0ddc-4870-a8d6-859aa2980bf8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534901 Oct 20 13:42:20.294648 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 537/912] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:42:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 13:42:20.300679 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9620e946-8e72-49c4-91a7-5b85b5d4b815 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:20.301338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9620e946-8e72-49c4-91a7-5b85b5d4b815 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:20.309065 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:20.365857 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9620e946-8e72-49c4-91a7-5b85b5d4b815 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:20.373678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9620e946-8e72-49c4-91a7-5b85b5d4b815 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1214 microversion: 2.1 time: 0.077373 Oct 20 13:42:20.374441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 538/913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:20 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:20.781386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:20.782028 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:20.791127 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:20.791697 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:20.792542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:20.793612 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:20.794141 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:20.794656 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:20.809559 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea HTTP/1.1 Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:20.811397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:42:20.812707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'a07ca6e8-83ee-4690-97c1-7cc13774d5ea'} Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:20.813481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:42:20.814658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:20.816390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:20.816390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e21431ef-d060-45f5-90b6-06d8a4740e18 tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 404 len: 111 microversion: 2.1 time: 0.036200 Oct 20 13:42:20.816390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 539/914] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:42:20 2022] DELETE /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:42:20.821768 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:20.822375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] [instance: a07ca6e8-83ee-4690-97c1-7cc13774d5ea] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:20.828190 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:20.828679 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:20.829156 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:20.829847 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:20.830298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:20.830765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:20.844368 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] HTTP exception thrown: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Request method failure captured: Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea HTTP/1.1 Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6stAwaPt748LHsGeFeP9Auuqo47ontMwKK2Fae-vrsZlnWVMaHDHGsi47psTqSKPZGXEn9T1uYHDTld83iBAOzfbHesyrnAd8vPGnR_aWME4Ze9c5bsiY-Xj_CZyMtaqtk1nKd2eElWQuQ6MiHo1uTz7DVQkVtDzfMHn2V90ZiCmo Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:20.845917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b215cb88123a4851932dbf7dfa88f709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: b215cb88123a4851932dbf7dfa88f709 Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507594223 Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 144e9801ac1f470083d11647652ccdf1 Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeNegativeTest-1507594223-project Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:42:20.847801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'a07ca6e8-83ee-4690-97c1-7cc13774d5ea'} Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:20.848672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. Oct 20 13:42:20.850032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:20.851158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] Returning 404 to user: Instance a07ca6e8-83ee-4690-97c1-7cc13774d5ea could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:20.851158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0267922a-f226-457d-bfa0-413e051769eb tempest-AttachVolumeNegativeTest-1507594223 tempest-AttachVolumeNegativeTest-1507594223-project] 10.222.0.23 "GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea" status: 404 len: 111 microversion: 2.1 time: 0.029942 Oct 20 13:42:20.851158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 540/915] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:20 2022] GET /compute/v2.1/servers/a07ca6e8-83ee-4690-97c1-7cc13774d5ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:21.398224 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5d36c76d-5851-4c74-b451-5922da6d6c2e tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:21.399292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5d36c76d-5851-4c74-b451-5922da6d6c2e tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:21.430448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5d36c76d-5851-4c74-b451-5922da6d6c2e tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:21.431341 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5d36c76d-5851-4c74-b451-5922da6d6c2e tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:21.432119 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5d36c76d-5851-4c74-b451-5922da6d6c2e tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:21.433171 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5d36c76d-5851-4c74-b451-5922da6d6c2e tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:21.434110 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5d36c76d-5851-4c74-b451-5922da6d6c2e tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:21.434828 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5d36c76d-5851-4c74-b451-5922da6d6c2e tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:21.536914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5d36c76d-5851-4c74-b451-5922da6d6c2e tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:21.551840 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5d36c76d-5851-4c74-b451-5922da6d6c2e tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1274 microversion: 2.1 time: 0.158998 Oct 20 13:42:21.554207 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 541/916] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:21 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:22.588099 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7e70e24e-1ac4-45bc-ac77-b6ff2890b56c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:22.588656 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7e70e24e-1ac4-45bc-ac77-b6ff2890b56c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:22.613622 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e70e24e-1ac4-45bc-ac77-b6ff2890b56c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:22.614113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e70e24e-1ac4-45bc-ac77-b6ff2890b56c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:22.614543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e70e24e-1ac4-45bc-ac77-b6ff2890b56c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:22.615275 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e70e24e-1ac4-45bc-ac77-b6ff2890b56c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:22.615721 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e70e24e-1ac4-45bc-ac77-b6ff2890b56c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:22.616136 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7e70e24e-1ac4-45bc-ac77-b6ff2890b56c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:22.906633 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7e70e24e-1ac4-45bc-ac77-b6ff2890b56c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:22.917929 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7e70e24e-1ac4-45bc-ac77-b6ff2890b56c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1314 microversion: 2.1 time: 0.343910 Oct 20 13:42:22.931070 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 542/917] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:22 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:23.436751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-2de31336-1919-48b2-b145-5553a84ee498 req-ece256f7-7fcc-4238-af11-24409508cfec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3911c421-ac69-4c69-bc0d-c97e164b09a6", "tag": "262e3b0d-fd4b-4cc7-92c8-98dada8441ba"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:23.458913 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2de31336-1919-48b2-b145-5553a84ee498 req-ece256f7-7fcc-4238-af11-24409508cfec service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:23.459410 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2de31336-1919-48b2-b145-5553a84ee498 req-ece256f7-7fcc-4238-af11-24409508cfec service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:23.459846 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2de31336-1919-48b2-b145-5553a84ee498 req-ece256f7-7fcc-4238-af11-24409508cfec service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:23.493801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-2de31336-1919-48b2-b145-5553a84ee498 req-ece256f7-7fcc-4238-af11-24409508cfec service nova] Creating event network-changed:262e3b0d-fd4b-4cc7-92c8-98dada8441ba for instance 3911c421-ac69-4c69-bc0d-c97e164b09a6 on hv-cinder-86213 Oct 20 13:42:23.514736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-2de31336-1919-48b2-b145-5553a84ee498 req-ece256f7-7fcc-4238-af11-24409508cfec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082222 Oct 20 13:42:23.515845 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 543/918] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:42:23.946345 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-86cdcad2-edf8-478b-9c95-3b251100d6e4 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:23.947078 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-86cdcad2-edf8-478b-9c95-3b251100d6e4 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:23.953426 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-86cdcad2-edf8-478b-9c95-3b251100d6e4 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:23.954160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-86cdcad2-edf8-478b-9c95-3b251100d6e4 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:23.954774 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-86cdcad2-edf8-478b-9c95-3b251100d6e4 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:23.955824 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-86cdcad2-edf8-478b-9c95-3b251100d6e4 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:23.956462 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-86cdcad2-edf8-478b-9c95-3b251100d6e4 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:23.957506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-86cdcad2-edf8-478b-9c95-3b251100d6e4 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:24.212167 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-86cdcad2-edf8-478b-9c95-3b251100d6e4 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:24.220459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-86cdcad2-edf8-478b-9c95-3b251100d6e4 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1314 microversion: 2.1 time: 0.281964 Oct 20 13:42:24.221167 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 544/919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:23 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:25.243814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8e791842-ef4f-43fb-bb08-2eafdc5ac09c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:25.245092 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8e791842-ef4f-43fb-bb08-2eafdc5ac09c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:25.254092 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e791842-ef4f-43fb-bb08-2eafdc5ac09c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:25.254911 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e791842-ef4f-43fb-bb08-2eafdc5ac09c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:25.255352 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e791842-ef4f-43fb-bb08-2eafdc5ac09c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:25.256115 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e791842-ef4f-43fb-bb08-2eafdc5ac09c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:25.256642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e791842-ef4f-43fb-bb08-2eafdc5ac09c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:25.257097 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e791842-ef4f-43fb-bb08-2eafdc5ac09c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:25.285532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:25.493316 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8e791842-ef4f-43fb-bb08-2eafdc5ac09c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:25.503812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8e791842-ef4f-43fb-bb08-2eafdc5ac09c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1314 microversion: 2.1 time: 0.263694 Oct 20 13:42:25.505390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 545/920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:25 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:26.526950 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5696ab4b-5344-4fa8-bd5f-233b1a9a2587 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:26.527566 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5696ab4b-5344-4fa8-bd5f-233b1a9a2587 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:26.536394 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5696ab4b-5344-4fa8-bd5f-233b1a9a2587 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:26.536916 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5696ab4b-5344-4fa8-bd5f-233b1a9a2587 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:26.537349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5696ab4b-5344-4fa8-bd5f-233b1a9a2587 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:26.538434 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5696ab4b-5344-4fa8-bd5f-233b1a9a2587 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:26.538810 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5696ab4b-5344-4fa8-bd5f-233b1a9a2587 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:26.539294 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5696ab4b-5344-4fa8-bd5f-233b1a9a2587 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:26.696186 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5696ab4b-5344-4fa8-bd5f-233b1a9a2587 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:26.709174 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5696ab4b-5344-4fa8-bd5f-233b1a9a2587 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1314 microversion: 2.1 time: 0.185530 Oct 20 13:42:26.710028 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 546/921] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:26 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:27.734291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-bb1682e7-cc93-4bd9-b2d5-4dfc3d76b614 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:27.734938 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-bb1682e7-cc93-4bd9-b2d5-4dfc3d76b614 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:27.742978 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb1682e7-cc93-4bd9-b2d5-4dfc3d76b614 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:27.743925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb1682e7-cc93-4bd9-b2d5-4dfc3d76b614 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:27.744760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb1682e7-cc93-4bd9-b2d5-4dfc3d76b614 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:27.745711 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb1682e7-cc93-4bd9-b2d5-4dfc3d76b614 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:27.746361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb1682e7-cc93-4bd9-b2d5-4dfc3d76b614 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:27.746936 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-bb1682e7-cc93-4bd9-b2d5-4dfc3d76b614 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:27.900367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-bb1682e7-cc93-4bd9-b2d5-4dfc3d76b614 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:27.912405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-bb1682e7-cc93-4bd9-b2d5-4dfc3d76b614 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1314 microversion: 2.1 time: 0.183785 Oct 20 13:42:27.913026 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 547/922] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:27 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:28.936804 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c81bc2dc-00e9-446f-98a1-7d8ac44f7a2c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:28.937657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c81bc2dc-00e9-446f-98a1-7d8ac44f7a2c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:28.945130 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c81bc2dc-00e9-446f-98a1-7d8ac44f7a2c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:28.945631 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c81bc2dc-00e9-446f-98a1-7d8ac44f7a2c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:28.946133 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c81bc2dc-00e9-446f-98a1-7d8ac44f7a2c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:28.946957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c81bc2dc-00e9-446f-98a1-7d8ac44f7a2c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:28.947998 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c81bc2dc-00e9-446f-98a1-7d8ac44f7a2c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:28.948573 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c81bc2dc-00e9-446f-98a1-7d8ac44f7a2c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:29.093609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c81bc2dc-00e9-446f-98a1-7d8ac44f7a2c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:29.104269 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c81bc2dc-00e9-446f-98a1-7d8ac44f7a2c tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1314 microversion: 2.1 time: 0.171444 Oct 20 13:42:29.105837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 548/923] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:28 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:30.000798 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-b2163540-a91d-4316-9d54-2087b5d6b693 req-06640f2b-ea18-4f24-9517-d1384992e3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3911c421-ac69-4c69-bc0d-c97e164b09a6", "name": "network-vif-plugged", "status": "completed", "tag": "262e3b0d-fd4b-4cc7-92c8-98dada8441ba"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:30.012724 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-b2163540-a91d-4316-9d54-2087b5d6b693 req-06640f2b-ea18-4f24-9517-d1384992e3d2 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:30.013743 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-b2163540-a91d-4316-9d54-2087b5d6b693 req-06640f2b-ea18-4f24-9517-d1384992e3d2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:30.014180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-b2163540-a91d-4316-9d54-2087b5d6b693 req-06640f2b-ea18-4f24-9517-d1384992e3d2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:30.028965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-b2163540-a91d-4316-9d54-2087b5d6b693 req-06640f2b-ea18-4f24-9517-d1384992e3d2 service nova] Creating event network-vif-plugged:262e3b0d-fd4b-4cc7-92c8-98dada8441ba for instance 3911c421-ac69-4c69-bc0d-c97e164b09a6 on hv-cinder-86213 Oct 20 13:42:30.034957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-b2163540-a91d-4316-9d54-2087b5d6b693 req-06640f2b-ea18-4f24-9517-d1384992e3d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037746 Oct 20 13:42:30.035548 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 549/924] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:42:30.131149 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e905961f-3188-42fe-998a-e3480a3176d9 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:30.131841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e905961f-3188-42fe-998a-e3480a3176d9 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:30.139934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e905961f-3188-42fe-998a-e3480a3176d9 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:30.140607 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e905961f-3188-42fe-998a-e3480a3176d9 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:30.141886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e905961f-3188-42fe-998a-e3480a3176d9 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:30.143049 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e905961f-3188-42fe-998a-e3480a3176d9 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:30.143748 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e905961f-3188-42fe-998a-e3480a3176d9 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:30.144324 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e905961f-3188-42fe-998a-e3480a3176d9 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:30.211654 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:30.337771 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e905961f-3188-42fe-998a-e3480a3176d9 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:30.345882 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e905961f-3188-42fe-998a-e3480a3176d9 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1314 microversion: 2.1 time: 0.219514 Oct 20 13:42:30.346468 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 550/925] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:30 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:31.368578 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c4ba7d2e-6c22-4b84-8294-a0963f5c3a39 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:31.369263 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c4ba7d2e-6c22-4b84-8294-a0963f5c3a39 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:31.371018 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=8 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:31.377244 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4ba7d2e-6c22-4b84-8294-a0963f5c3a39 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:31.377548 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4ba7d2e-6c22-4b84-8294-a0963f5c3a39 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:31.377981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4ba7d2e-6c22-4b84-8294-a0963f5c3a39 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:31.378666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4ba7d2e-6c22-4b84-8294-a0963f5c3a39 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:31.379122 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4ba7d2e-6c22-4b84-8294-a0963f5c3a39 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:31.379543 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4ba7d2e-6c22-4b84-8294-a0963f5c3a39 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:31.508493 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c4ba7d2e-6c22-4b84-8294-a0963f5c3a39 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:31.516102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c4ba7d2e-6c22-4b84-8294-a0963f5c3a39 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1314 microversion: 2.1 time: 0.151748 Oct 20 13:42:31.516657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 551/926] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:31 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:32.538337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b14de57a-3e7a-4e25-bb70-4c48663971e7 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:32.539032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b14de57a-3e7a-4e25-bb70-4c48663971e7 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:32.545741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b14de57a-3e7a-4e25-bb70-4c48663971e7 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:32.546229 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b14de57a-3e7a-4e25-bb70-4c48663971e7 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:32.546660 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b14de57a-3e7a-4e25-bb70-4c48663971e7 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:32.547351 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b14de57a-3e7a-4e25-bb70-4c48663971e7 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:32.547802 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b14de57a-3e7a-4e25-bb70-4c48663971e7 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:32.548221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b14de57a-3e7a-4e25-bb70-4c48663971e7 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:32.687215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b14de57a-3e7a-4e25-bb70-4c48663971e7 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:32.695465 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b14de57a-3e7a-4e25-bb70-4c48663971e7 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1499 microversion: 2.1 time: 0.160926 Oct 20 13:42:32.696280 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 552/927] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:32 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:33.202536 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-58d5c6d0-de80-4f2b-bb63-6b553ce49149 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:33.203064 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-58d5c6d0-de80-4f2b-bb63-6b553ce49149 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:33.209958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-58d5c6d0-de80-4f2b-bb63-6b553ce49149 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:33.210439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-58d5c6d0-de80-4f2b-bb63-6b553ce49149 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:33.210877 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-58d5c6d0-de80-4f2b-bb63-6b553ce49149 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:33.211578 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-58d5c6d0-de80-4f2b-bb63-6b553ce49149 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:33.212053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-58d5c6d0-de80-4f2b-bb63-6b553ce49149 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:33.212483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-58d5c6d0-de80-4f2b-bb63-6b553ce49149 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:33.249383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-58d5c6d0-de80-4f2b-bb63-6b553ce49149 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:42:33.377800 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-58d5c6d0-de80-4f2b-bb63-6b553ce49149 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 204 len: 0 microversion: 2.1 time: 0.174197 Oct 20 13:42:33.378506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 553/928] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:42:33 2022] DELETE /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 20 13:42:33.389666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7280c2f3-d22b-41a0-8b94-bbb62cc318c5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:33.390474 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7280c2f3-d22b-41a0-8b94-bbb62cc318c5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:33.397261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7280c2f3-d22b-41a0-8b94-bbb62cc318c5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:33.397745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7280c2f3-d22b-41a0-8b94-bbb62cc318c5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:33.398180 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7280c2f3-d22b-41a0-8b94-bbb62cc318c5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:33.398868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7280c2f3-d22b-41a0-8b94-bbb62cc318c5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:33.401319 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7280c2f3-d22b-41a0-8b94-bbb62cc318c5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:33.401918 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7280c2f3-d22b-41a0-8b94-bbb62cc318c5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:33.546607 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7280c2f3-d22b-41a0-8b94-bbb62cc318c5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:33.554626 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7280c2f3-d22b-41a0-8b94-bbb62cc318c5 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1505 microversion: 2.1 time: 0.169053 Oct 20 13:42:33.555199 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 554/929] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:33 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:34.579884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9ef00a47-2ce3-40c2-afa7-23488d00f1b8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:34.580822 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9ef00a47-2ce3-40c2-afa7-23488d00f1b8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:34.587432 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ef00a47-2ce3-40c2-afa7-23488d00f1b8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:34.587998 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ef00a47-2ce3-40c2-afa7-23488d00f1b8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:34.588497 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ef00a47-2ce3-40c2-afa7-23488d00f1b8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:34.589277 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ef00a47-2ce3-40c2-afa7-23488d00f1b8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:34.590146 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ef00a47-2ce3-40c2-afa7-23488d00f1b8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:34.590292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9ef00a47-2ce3-40c2-afa7-23488d00f1b8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:34.736926 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9ef00a47-2ce3-40c2-afa7-23488d00f1b8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:34.744793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9ef00a47-2ce3-40c2-afa7-23488d00f1b8 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1505 microversion: 2.1 time: 0.169271 Oct 20 13:42:34.745512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 555/930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:34 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:35.355125 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-ca3483e8-3c94-45f6-b8de-7784e8a66b56 req-29e2769d-1b46-4a67-8ce0-20efc5b7e80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3911c421-ac69-4c69-bc0d-c97e164b09a6", "name": "network-vif-deleted", "tag": "262e3b0d-fd4b-4cc7-92c8-98dada8441ba"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:35.377200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ca3483e8-3c94-45f6-b8de-7784e8a66b56 req-29e2769d-1b46-4a67-8ce0-20efc5b7e80a service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:35.378268 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ca3483e8-3c94-45f6-b8de-7784e8a66b56 req-29e2769d-1b46-4a67-8ce0-20efc5b7e80a service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:35.378268 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-ca3483e8-3c94-45f6-b8de-7784e8a66b56 req-29e2769d-1b46-4a67-8ce0-20efc5b7e80a service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:35.395084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-ca3483e8-3c94-45f6-b8de-7784e8a66b56 req-29e2769d-1b46-4a67-8ce0-20efc5b7e80a service nova] Creating event network-vif-deleted:262e3b0d-fd4b-4cc7-92c8-98dada8441ba for instance 3911c421-ac69-4c69-bc0d-c97e164b09a6 on hv-cinder-86213 Oct 20 13:42:35.401473 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-ca3483e8-3c94-45f6-b8de-7784e8a66b56 req-29e2769d-1b46-4a67-8ce0-20efc5b7e80a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050832 Oct 20 13:42:35.402597 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 556/931] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:42:35.770005 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:35.770692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:35.776777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:35.777286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:35.777711 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:35.778380 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:35.778850 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:35.779261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:35.815956 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:35.816421 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:35.816845 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:35.817347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lazy-loading 'fault' on Instance uuid 3911c421-ac69-4c69-bc0d-c97e164b09a6 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:42:35.858718 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c04718cd82496abbc82e353873e604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a444b7fa425b4f0ba7833b93607daa25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:35.868998 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e99ec902-e718-4d88-83b5-f2024bddfe55 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 200 len: 1304 microversion: 2.1 time: 0.103864 Oct 20 13:42:35.870336 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 557/932] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:35 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:42:36.891714 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:36.892383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] [instance: 3911c421-ac69-4c69-bc0d-c97e164b09a6] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:36.898958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:36.899444 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:36.899879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:36.900568 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:36.901060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:36.901482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:36.914675 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] HTTP exception thrown: Instance 3911c421-ac69-4c69-bc0d-c97e164b09a6 could not be found. Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Request method failure captured: Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 HTTP/1.1 Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUVAmZS-EtNqWZSoGtemOblEeLmWfw69Egka2jiqdXQYkAMmRuiK4CvXFNr3Q08k9Sy65FKOZXPnFsUufBpH8tgUUD0j5daYZyYemlD-YUDHz0Ot5eRt7_fVz9wIrv0NbEyDtfqqJigIl9NuRcVRy_QtD7wUU8SoaBCP-SSgNypJ51hU Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: a444b7fa425b4f0ba7833b93607daa25 Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesActionsTest-1331623610 Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:36.916295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a444b7fa425b4f0ba7833b93607daa25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a444b7fa425b4f0ba7833b93607daa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a444b7fa425b4f0ba7833b93607daa25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a444b7fa425b4f0ba7833b93607daa25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesActionsTest-1331623610 Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: a444b7fa425b4f0ba7833b93607daa25 Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesActionsTest-1331623610 Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesActionsTest-1331623610-project Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 69c04718cd82496abbc82e353873e604 Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesActionsTest-1331623610-project Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 3911c421-ac69-4c69-bc0d-c97e164b09a6 could not be found. Oct 20 13:42:36.917903 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '3911c421-ac69-4c69-bc0d-c97e164b09a6'} Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3911c421-ac69-4c69-bc0d-c97e164b09a6 could not be found. Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:36.918811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3911c421-ac69-4c69-bc0d-c97e164b09a6 could not be found. Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3911c421-ac69-4c69-bc0d-c97e164b09a6 could not be found. Oct 20 13:42:36.920292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:36.921687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] Returning 404 to user: Instance 3911c421-ac69-4c69-bc0d-c97e164b09a6 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:36.921687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-26eb593e-f157-4117-8a3a-63cc242c4a23 tempest-VolumesActionsTest-1331623610 tempest-VolumesActionsTest-1331623610-project] 10.222.0.23 "GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6" status: 404 len: 111 microversion: 2.1 time: 0.030012 Oct 20 13:42:36.921687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 558/933] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:42:36 2022] GET /compute/v2.1/servers/3911c421-ac69-4c69-bc0d-c97e164b09a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:42:42.254292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f46a278a-a362-4d0f-849d-771c19db62c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:42.256609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f46a278a-a362-4d0f-849d-771c19db62c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:42.263463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f46a278a-a362-4d0f-849d-771c19db62c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:42.264196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f46a278a-a362-4d0f-849d-771c19db62c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:42.264843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f46a278a-a362-4d0f-849d-771c19db62c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:42.265927 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f46a278a-a362-4d0f-849d-771c19db62c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:42.266578 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f46a278a-a362-4d0f-849d-771c19db62c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:42.267232 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f46a278a-a362-4d0f-849d-771c19db62c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:42.304934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f46a278a-a362-4d0f-849d-771c19db62c0 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054451 Oct 20 13:42:42.316962 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 559/934] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 20 13:42:42 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:42:42.381956 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3c4077ce-e662-494e-8f75-19e76d87f6cd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:42.382449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3c4077ce-e662-494e-8f75-19e76d87f6cd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:42.388599 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c4077ce-e662-494e-8f75-19e76d87f6cd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:42.389438 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c4077ce-e662-494e-8f75-19e76d87f6cd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:42.389880 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c4077ce-e662-494e-8f75-19e76d87f6cd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:42.390784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c4077ce-e662-494e-8f75-19e76d87f6cd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:42.391421 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c4077ce-e662-494e-8f75-19e76d87f6cd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:42.391841 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3c4077ce-e662-494e-8f75-19e76d87f6cd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:42.423169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3c4077ce-e662-494e-8f75-19e76d87f6cd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:42:42.479930 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:42.539787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3c4077ce-e662-494e-8f75-19e76d87f6cd tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 204 len: 0 microversion: 2.20 time: 0.161322 Oct 20 13:42:42.540375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 560/935] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 20 13:42:42 2022] DELETE /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 20 13:42:42.549682 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:42.550650 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:42.557521 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:42.558235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:42.558667 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:42.559361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:42.559804 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:42.560219 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:42.820280 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:42.828857 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:42.830958 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:42.832534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5fd9f8ba-e173-4425-bf43-746b3a7c78f6 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1722 microversion: 2.20 time: 0.287163 Oct 20 13:42:42.833375 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 561/936] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:42 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:42:43.860312 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:43.861088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:43.886383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:43.886749 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:43.891252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:43.892081 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:43.893504 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:43.894056 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:44.081260 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:44.090188 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:44.091619 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:44.093008 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-08f93e8d-4783-49cd-b73d-411b5932b457 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1722 microversion: 2.20 time: 0.236795 Oct 20 13:42:44.093916 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 562/937] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:43 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:42:45.129505 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:45.130974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:45.141981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:45.143278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:45.143883 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:45.144918 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:45.146118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:45.146998 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:45.295668 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:45.314030 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:45.316329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:45.318056 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2a3443f2-a338-4d11-906b-4cb8b4150485 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1654 microversion: 2.20 time: 0.202053 Oct 20 13:42:45.345330 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 563/938] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:45 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1654 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 13:42:45.465157 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-005bf92e-3276-4bbc-964b-2bb27289085b req-ef3a2de9-98f4-4bf4-a898-7fc5d8457b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34aa5d9-ed42-4cdd-bed0-229455d27cf1", "name": "network-vif-deleted", "tag": "220d420d-8061-47e0-9323-3ec3344c20c6"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:45.476840 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-005bf92e-3276-4bbc-964b-2bb27289085b req-ef3a2de9-98f4-4bf4-a898-7fc5d8457b46 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:45.477343 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-005bf92e-3276-4bbc-964b-2bb27289085b req-ef3a2de9-98f4-4bf4-a898-7fc5d8457b46 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:45.477786 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-005bf92e-3276-4bbc-964b-2bb27289085b req-ef3a2de9-98f4-4bf4-a898-7fc5d8457b46 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:45.500266 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-005bf92e-3276-4bbc-964b-2bb27289085b req-ef3a2de9-98f4-4bf4-a898-7fc5d8457b46 service nova] Creating event network-vif-deleted:220d420d-8061-47e0-9323-3ec3344c20c6 for instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 on hv-cinder-86213 Oct 20 13:42:45.531507 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-005bf92e-3276-4bbc-964b-2bb27289085b req-ef3a2de9-98f4-4bf4-a898-7fc5d8457b46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068290 Oct 20 13:42:45.532704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 564/939] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:42:46.359350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:46.360755 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:46.369401 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:46.370266 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:46.370957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:46.374610 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:46.375313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:46.375802 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:46.429964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:46.430579 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:46.431471 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:46.432117 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lazy-loading 'fault' on Instance uuid c34aa5d9-ed42-4cdd-bed0-229455d27cf1 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:42:46.490802 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:46.499890 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:46.505100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55526ddbea014e6cbf7c079cb204059e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9addc326c51410f809805d8b44c5c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:42:46.506877 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-204cbd35-f58b-4d35-8341-a19950c25e8a tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 200 len: 1370 microversion: 2.20 time: 0.162648 Oct 20 13:42:46.507654 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 565/940] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:46 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 13:42:47.538729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:47.539404 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:47.545519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:47.545997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:47.546429 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:47.547147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:47.547605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:47.548025 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:47.562150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] HTTP exception thrown: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Request method failure captured: Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 HTTP/1.1 Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6yUtEnt2EtPF7G1mURPCnzR_5_e5eJ-J2u3s3iMnmuMh3NQnc7cLPiUlcQiomZhWnF6wUInAYBkYEDpSkwWcjlck_m6LADHNrTNRcuev5ztbzIzwhAv59BAquofQ96WzAp7T6sW17gb0Vtbqvan27ep67VGFXveP7w9n7BmWHCUdU Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:47.563812 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9addc326c51410f809805d8b44c5c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 55526ddbea014e6cbf7c079cb204059e Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:47.566131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'c34aa5d9-ed42-4cdd-bed0-229455d27cf1'} Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:47.567059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:47.568533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:47.569899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Returning 404 to user: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:47.569899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d1c30e40-1db2-4ecc-a12b-4f7dec1cb794 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 404 len: 111 microversion: 2.20 time: 0.031191 Oct 20 13:42:47.569899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 566/941] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:47 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 20 13:42:47.578700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7be1d885-da7b-494c-a7ef-b3f9d1b1c714 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '.version_select at 0x7ffa12ec2e50>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:47.599216 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7be1d885-da7b-494c-a7ef-b3f9d1b1c714 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38668589" status: 204 len: 0 microversion: 2.20 time: 0.024218 Oct 20 13:42:47.599794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 567/942] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 20 13:42:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38668589 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 20 13:42:49.528431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:49.529079 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:49.550816 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:49.551306 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:49.551838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:49.552928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:49.553828 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:49.554467 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:49.578556 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] HTTP exception thrown: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Request method failure captured: Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 HTTP/1.1 Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6yUtEnt2EtPF7G1mURPCnzR_5_e5eJ-J2u3s3iMnmuMh3NQnc7cLPiUlcQiomZhWnF6wUInAYBkYEDpSkwWcjlck_m6LADHNrTNRcuev5ztbzIzwhAv59BAquofQ96WzAp7T6sW17gb0Vtbqvan27ep67VGFXveP7w9n7BmWHCUdU Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:49.582364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9addc326c51410f809805d8b44c5c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 55526ddbea014e6cbf7c079cb204059e Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:49.583994 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'c34aa5d9-ed42-4cdd-bed0-229455d27cf1'} Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:49.585147 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:49.586884 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:49.589426 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Returning 404 to user: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:49.592138 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2859bc8d-aae3-4f87-b27f-2a4f76c38614 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 404 len: 111 microversion: 2.20 time: 0.068882 Oct 20 13:42:49.593300 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 568/943] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 20 13:42:49 2022] DELETE /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 20 13:42:49.604425 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:49.605554 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: c34aa5d9-ed42-4cdd-bed0-229455d27cf1] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:49.613245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:49.613719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:49.614264 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:49.616177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:49.617028 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:49.618349 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:49.649780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] HTTP exception thrown: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Request method failure captured: Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 HTTP/1.1 Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6yUtEnt2EtPF7G1mURPCnzR_5_e5eJ-J2u3s3iMnmuMh3NQnc7cLPiUlcQiomZhWnF6wUInAYBkYEDpSkwWcjlck_m6LADHNrTNRcuev5ztbzIzwhAv59BAquofQ96WzAp7T6sW17gb0Vtbqvan27ep67VGFXveP7w9n7BmWHCUdU Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:49.651328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9addc326c51410f809805d8b44c5c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 55526ddbea014e6cbf7c079cb204059e Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:49.652829 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'c34aa5d9-ed42-4cdd-bed0-229455d27cf1'} Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:49.653638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. Oct 20 13:42:49.654848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:49.655945 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Returning 404 to user: Instance c34aa5d9-ed42-4cdd-bed0-229455d27cf1 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:49.655945 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7a2c479f-cbe0-49fd-a057-00daffcb2c8f tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1" status: 404 len: 111 microversion: 2.20 time: 0.054318 Oct 20 13:42:49.655945 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 569/944] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:49 2022] GET /compute/v2.1/servers/c34aa5d9-ed42-4cdd-bed0-229455d27cf1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 13:42:50.819794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:50.820491 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:50.823039 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:50.829811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:50.830482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:50.831142 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:50.832053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:50.832717 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:50.833243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:50.853835 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] HTTP exception thrown: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Request method failure captured: Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 HTTP/1.1 Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6yUtEnt2EtPF7G1mURPCnzR_5_e5eJ-J2u3s3iMnmuMh3NQnc7cLPiUlcQiomZhWnF6wUInAYBkYEDpSkwWcjlck_m6LADHNrTNRcuev5ztbzIzwhAv59BAquofQ96WzAp7T6sW17gb0Vtbqvan27ep67VGFXveP7w9n7BmWHCUdU Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:50.856132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9addc326c51410f809805d8b44c5c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 55526ddbea014e6cbf7c079cb204059e Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:42:50.857751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '93b9ae5b-1e55-409f-9a61-b1e2a47d1b58'} Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:50.862272 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:42:50.863552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:50.865764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Returning 404 to user: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:50.865764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-414ec7d5-b2da-4583-95bd-7190adfb8c79 tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 404 len: 111 microversion: 2.20 time: 0.041887 Oct 20 13:42:50.865764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 570/945] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 20 13:42:50 2022] DELETE /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 20 13:42:50.869946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:50.872635 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] [instance: 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:50.883953 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:50.885231 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:50.886048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:50.887165 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:50.887952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:50.888793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:50.909301 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] HTTP exception thrown: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Request method failure captured: Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 HTTP/1.1 Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU6yUtEnt2EtPF7G1mURPCnzR_5_e5eJ-J2u3s3iMnmuMh3NQnc7cLPiUlcQiomZhWnF6wUInAYBkYEDpSkwWcjlck_m6LADHNrTNRcuev5ztbzIzwhAv59BAquofQ96WzAp7T6sW17gb0Vtbqvan27ep67VGFXveP7w9n7BmWHCUdU Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:42:50.911537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9addc326c51410f809805d8b44c5c17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9addc326c51410f809805d8b44c5c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: f9addc326c51410f809805d8b44c5c17 Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-427809982 Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 55526ddbea014e6cbf7c079cb204059e Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-AttachVolumeShelveTestJSON-427809982-project Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:42:50.913367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '93b9ae5b-1e55-409f-9a61-b1e2a47d1b58'} Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:42:50.914236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. Oct 20 13:42:50.915686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:42:50.918513 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] Returning 404 to user: Instance 93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:42:50.919707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-eeb364ee-8646-4656-8b2e-296ef1a36aca tempest-AttachVolumeShelveTestJSON-427809982 tempest-AttachVolumeShelveTestJSON-427809982-project] 10.222.0.23 "GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58" status: 404 len: 111 microversion: 2.20 time: 0.057377 Oct 20 13:42:50.920269 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 571/946] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 20 13:42:50 2022] GET /compute/v2.1/servers/93b9ae5b-1e55-409f-9a61-b1e2a47d1b58 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 13:42:57.883383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-71986621-2294-474d-b497-95e10b8aef88 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Action: 'create', calling method: .version_select at 0x7ffa12e6c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1890028540"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:58.301406 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-71986621-2294-474d-b497-95e10b8aef88 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.765663 Oct 20 13:42:58.302583 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 572/947] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Oct 20 13:42:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 767 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 20 13:42:58.307623 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-56d026cb-2638-4474-9d0f-7dae6648a682 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1619157036"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:58.310510 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-56d026cb-2638-4474-9d0f-7dae6648a682 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:42:58.322382 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56d026cb-2638-4474-9d0f-7dae6648a682 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:58.323439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56d026cb-2638-4474-9d0f-7dae6648a682 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:58.323967 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56d026cb-2638-4474-9d0f-7dae6648a682 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:58.325338 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56d026cb-2638-4474-9d0f-7dae6648a682 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:58.325788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56d026cb-2638-4474-9d0f-7dae6648a682 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:58.326321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-56d026cb-2638-4474-9d0f-7dae6648a682 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:58.503366 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.network.security_group_api [None req-56d026cb-2638-4474-9d0f-7dae6648a682 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Removing security group 5478a9d8-2f05-4d92-8662-da8f5dbdb472 from port 57704c11-9966-4dc7-ba8b-0af092c2b73f Oct 20 13:42:58.853803 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-56d026cb-2638-4474-9d0f-7dae6648a682 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "POST /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/action" status: 202 len: 0 microversion: 2.1 time: 0.549853 Oct 20 13:42:58.854470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 573/948] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:42:58 2022] POST /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:42:58.873925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-05162da4-02dc-406d-8754-319bfe353a2c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12dffa60>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:42:58.936816 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-05162da4-02dc-406d-8754-319bfe353a2c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062" status: 200 len: 345 microversion: 2.1 time: 0.080906 Oct 20 13:42:58.937856 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 574/949] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:42:58 2022] GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:42:58.953370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-9a398772-828e-43cc-ba16-76f07e1b2cd1 req-9a06334c-8bb6-4976-a905-926d22b4a2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89b72ca-c19d-4976-97be-086660601e2b", "tag": "57704c11-9966-4dc7-ba8b-0af092c2b73f"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:42:58.964292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-9a398772-828e-43cc-ba16-76f07e1b2cd1 req-9a06334c-8bb6-4976-a905-926d22b4a2c9 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:42:58.964765 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-9a398772-828e-43cc-ba16-76f07e1b2cd1 req-9a06334c-8bb6-4976-a905-926d22b4a2c9 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:42:58.965965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-9a398772-828e-43cc-ba16-76f07e1b2cd1 req-9a06334c-8bb6-4976-a905-926d22b4a2c9 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:42:58.979872 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-9a398772-828e-43cc-ba16-76f07e1b2cd1 req-9a06334c-8bb6-4976-a905-926d22b4a2c9 service nova] Creating event network-changed:57704c11-9966-4dc7-ba8b-0af092c2b73f for instance e89b72ca-c19d-4976-97be-086660601e2b on hv-cinder-86213 Oct 20 13:42:58.986293 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-9a398772-828e-43cc-ba16-76f07e1b2cd1 req-9a06334c-8bb6-4976-a905-926d22b4a2c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045378 Oct 20 13:42:58.987796 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 575/950] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:42:59.958169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d9382a4e-3c64-47f7-9acb-b845d17f3830 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12e7e0d0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:00.013911 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d9382a4e-3c64-47f7-9acb-b845d17f3830 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062" status: 200 len: 345 microversion: 2.1 time: 0.060765 Oct 20 13:43:00.014482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 576/951] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:42:59 2022] GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:00.027101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2d582f13-0cbf-410a-a24a-1c8d7b5e91a6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:00.027742 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2d582f13-0cbf-410a-a24a-1c8d7b5e91a6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:00.034731 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d582f13-0cbf-410a-a24a-1c8d7b5e91a6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:00.035206 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d582f13-0cbf-410a-a24a-1c8d7b5e91a6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:00.035636 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d582f13-0cbf-410a-a24a-1c8d7b5e91a6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:00.036313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d582f13-0cbf-410a-a24a-1c8d7b5e91a6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:00.036757 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d582f13-0cbf-410a-a24a-1c8d7b5e91a6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:00.037217 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d582f13-0cbf-410a-a24a-1c8d7b5e91a6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:00.128353 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-2d582f13-0cbf-410a-a24a-1c8d7b5e91a6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lazy-loading 'services' on Instance uuid e89b72ca-c19d-4976-97be-086660601e2b {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:43:00.227981 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2d582f13-0cbf-410a-a24a-1c8d7b5e91a6 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments/c3db165f-4afb-442c-91f8-f481cc438d4d" status: 202 len: 0 microversion: 2.1 time: 0.204607 Oct 20 13:43:00.228892 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 577/952] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:43:00 2022] DELETE /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments/c3db165f-4afb-442c-91f8-f481cc438d4d => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 13:43:00.237718 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-61b2079d-d27c-4af3-8178-ba80a99584f2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:00.240485 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-61b2079d-d27c-4af3-8178-ba80a99584f2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:00.246817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-61b2079d-d27c-4af3-8178-ba80a99584f2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:00.247308 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-61b2079d-d27c-4af3-8178-ba80a99584f2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:00.247742 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-61b2079d-d27c-4af3-8178-ba80a99584f2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:00.248440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-61b2079d-d27c-4af3-8178-ba80a99584f2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:00.248918 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-61b2079d-d27c-4af3-8178-ba80a99584f2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:00.249346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-61b2079d-d27c-4af3-8178-ba80a99584f2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:00.279001 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-61b2079d-d27c-4af3-8178-ba80a99584f2 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Oct 20 13:43:00.279799 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 578/953] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:00 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:01.002510 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-2f404dc0-d930-45ec-a8d2-bd436ca5f7e3 req-c4a8093c-43f3-48d4-bcdd-2d6453ad4165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89b72ca-c19d-4976-97be-086660601e2b", "tag": "57704c11-9966-4dc7-ba8b-0af092c2b73f"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:43:01.012290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2f404dc0-d930-45ec-a8d2-bd436ca5f7e3 req-c4a8093c-43f3-48d4-bcdd-2d6453ad4165 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:01.012759 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2f404dc0-d930-45ec-a8d2-bd436ca5f7e3 req-c4a8093c-43f3-48d4-bcdd-2d6453ad4165 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:01.013214 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2f404dc0-d930-45ec-a8d2-bd436ca5f7e3 req-c4a8093c-43f3-48d4-bcdd-2d6453ad4165 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:01.024644 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-2f404dc0-d930-45ec-a8d2-bd436ca5f7e3 req-c4a8093c-43f3-48d4-bcdd-2d6453ad4165 service nova] Creating event network-changed:57704c11-9966-4dc7-ba8b-0af092c2b73f for instance e89b72ca-c19d-4976-97be-086660601e2b on hv-cinder-86213 Oct 20 13:43:01.029488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-2f404dc0-d930-45ec-a8d2-bd436ca5f7e3 req-c4a8093c-43f3-48d4-bcdd-2d6453ad4165 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030800 Oct 20 13:43:01.030066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 579/954] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:01.035001 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-29c21d02-67fe-4de0-b542-5ec4015b39b2 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12eb3d30>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:01.081550 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-29c21d02-67fe-4de0-b542-5ec4015b39b2 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062" status: 200 len: 345 microversion: 2.1 time: 0.050324 Oct 20 13:43:01.082461 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 580/955] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:01 2022] GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:01.291984 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7b22be38-7b14-43f8-809e-1fa3f4355eff tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:01.294233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7b22be38-7b14-43f8-809e-1fa3f4355eff tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:01.301682 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7b22be38-7b14-43f8-809e-1fa3f4355eff tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:01.302356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7b22be38-7b14-43f8-809e-1fa3f4355eff tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:01.302983 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7b22be38-7b14-43f8-809e-1fa3f4355eff tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:01.303831 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7b22be38-7b14-43f8-809e-1fa3f4355eff tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:01.304440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7b22be38-7b14-43f8-809e-1fa3f4355eff tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:01.304882 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7b22be38-7b14-43f8-809e-1fa3f4355eff tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:01.338839 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7b22be38-7b14-43f8-809e-1fa3f4355eff tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050997 Oct 20 13:43:01.339580 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 581/956] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:01 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:02.097946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-07571349-eb52-47e0-aa02-893723e9d01f tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12e8b430>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:02.164333 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-07571349-eb52-47e0-aa02-893723e9d01f tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062" status: 200 len: 346 microversion: 2.1 time: 0.070244 Oct 20 13:43:02.164924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 582/957] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:02 2022] GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:02.178653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-84225e66-f463-4197-bfb6-d25f6641fb78 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Action: 'create', calling method: .version_select at 0x7ffa12bab280>, body: {"snapshot": {"volume_id": "641abe3a-73b4-43bb-8d84-20b998934062", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1610864149"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:43:02.433759 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-84225e66-f463-4197-bfb6-d25f6641fb78 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.258979 Oct 20 13:43:02.434479 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 583/958] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Oct 20 13:43:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:02.440577 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e0335845-ece3-47b3-a6b3-1543681baaf8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:02.443660 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e0335845-ece3-47b3-a6b3-1543681baaf8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:02.452594 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0335845-ece3-47b3-a6b3-1543681baaf8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:02.453788 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0335845-ece3-47b3-a6b3-1543681baaf8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:02.455264 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0335845-ece3-47b3-a6b3-1543681baaf8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:02.456778 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0335845-ece3-47b3-a6b3-1543681baaf8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:02.458236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0335845-ece3-47b3-a6b3-1543681baaf8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:02.458837 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e0335845-ece3-47b3-a6b3-1543681baaf8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:02.498920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e0335845-ece3-47b3-a6b3-1543681baaf8 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063089 Oct 20 13:43:02.504783 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 584/959] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:02 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:02.518187 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3fa976c2-fa02-4a19-b55b-faba4b1d9a83 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa14215d30>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:02.619532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3fa976c2-fa02-4a19-b55b-faba4b1d9a83 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.113219 Oct 20 13:43:02.620022 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 585/960] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:02 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:02.631794 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-826878a7-54eb-458e-afd2-3157f577082f tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12e1d4c0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:02.676908 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-826878a7-54eb-458e-afd2-3157f577082f tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.049175 Oct 20 13:43:02.683536 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 586/961] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Oct 20 13:43:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:02.689918 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-eb8a7d5e-0596-48c7-98d2-a149a5c3886d tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa130374c0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:02.725116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-eb8a7d5e-0596-48c7-98d2-a149a5c3886d tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.039572 Oct 20 13:43:02.728904 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 587/962] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:02 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:03.512764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-54537d1e-6408-49d7-8c24-f5ac0215976f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:03.515919 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-54537d1e-6408-49d7-8c24-f5ac0215976f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:03.523905 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-54537d1e-6408-49d7-8c24-f5ac0215976f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:03.524733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-54537d1e-6408-49d7-8c24-f5ac0215976f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:03.525405 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-54537d1e-6408-49d7-8c24-f5ac0215976f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:03.526415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-54537d1e-6408-49d7-8c24-f5ac0215976f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:03.527320 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-54537d1e-6408-49d7-8c24-f5ac0215976f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:03.528008 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-54537d1e-6408-49d7-8c24-f5ac0215976f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:03.562076 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-54537d1e-6408-49d7-8c24-f5ac0215976f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053731 Oct 20 13:43:03.568457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 588/963] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:03 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:03.739736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f16dedb9-19ec-4d52-98a0-adaadf82dae3 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12e1daf0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:03.773176 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f16dedb9-19ec-4d52-98a0-adaadf82dae3 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.038734 Oct 20 13:43:03.774022 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 589/964] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:03 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:04.576968 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5a5e81f5-cb7c-443e-b9ac-6a84b1ab3f5e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:04.580568 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5a5e81f5-cb7c-443e-b9ac-6a84b1ab3f5e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:04.587169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a5e81f5-cb7c-443e-b9ac-6a84b1ab3f5e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:04.587866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a5e81f5-cb7c-443e-b9ac-6a84b1ab3f5e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:04.588516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a5e81f5-cb7c-443e-b9ac-6a84b1ab3f5e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:04.589295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a5e81f5-cb7c-443e-b9ac-6a84b1ab3f5e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:04.590043 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a5e81f5-cb7c-443e-b9ac-6a84b1ab3f5e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:04.590730 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5a5e81f5-cb7c-443e-b9ac-6a84b1ab3f5e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:04.626082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5a5e81f5-cb7c-443e-b9ac-6a84b1ab3f5e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054157 Oct 20 13:43:04.626986 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 590/965] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:04 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:04.786221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2e31106e-a662-4e21-ae63-86d336927c3e tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12e6a0d0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:04.822317 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2e31106e-a662-4e21-ae63-86d336927c3e tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.040337 Oct 20 13:43:04.823515 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 591/966] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:04 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:05.640197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7d2798b2-79ab-412d-8854-c111041e17a1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:05.642614 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7d2798b2-79ab-412d-8854-c111041e17a1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:05.649565 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d2798b2-79ab-412d-8854-c111041e17a1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:05.650511 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d2798b2-79ab-412d-8854-c111041e17a1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:05.651323 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d2798b2-79ab-412d-8854-c111041e17a1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:05.652256 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d2798b2-79ab-412d-8854-c111041e17a1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:05.652785 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d2798b2-79ab-412d-8854-c111041e17a1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:05.653351 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7d2798b2-79ab-412d-8854-c111041e17a1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:05.685780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7d2798b2-79ab-412d-8854-c111041e17a1 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049983 Oct 20 13:43:05.686984 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 592/967] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:05 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:05.835657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-afbde453-b011-49f9-a3f0-36a9f7b2229e tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa142151f0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:05.869786 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-afbde453-b011-49f9-a3f0-36a9f7b2229e tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.037863 Oct 20 13:43:05.875895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 593/968] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:05 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:06.700446 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9e0ef6bf-11b9-449b-abb2-b9a312ad4aaf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:06.703593 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9e0ef6bf-11b9-449b-abb2-b9a312ad4aaf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:06.710117 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9e0ef6bf-11b9-449b-abb2-b9a312ad4aaf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:06.710596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9e0ef6bf-11b9-449b-abb2-b9a312ad4aaf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:06.711033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9e0ef6bf-11b9-449b-abb2-b9a312ad4aaf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:06.711728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9e0ef6bf-11b9-449b-abb2-b9a312ad4aaf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:06.712183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9e0ef6bf-11b9-449b-abb2-b9a312ad4aaf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:06.712609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9e0ef6bf-11b9-449b-abb2-b9a312ad4aaf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:06.738215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:43:06.744022 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9e0ef6bf-11b9-449b-abb2-b9a312ad4aaf tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047988 Oct 20 13:43:06.744727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 594/969] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:06 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:06.883492 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-044dc6b6-409a-4104-a0b2-230a0a96ae3c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12eb3160>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:06.913355 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-044dc6b6-409a-4104-a0b2-230a0a96ae3c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.034275 Oct 20 13:43:06.913899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 595/970] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:06 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:07.757423 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-09d3736b-008c-455c-9d3a-13bf9885d8e7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:07.759551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-09d3736b-008c-455c-9d3a-13bf9885d8e7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:07.766843 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09d3736b-008c-455c-9d3a-13bf9885d8e7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:07.767314 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09d3736b-008c-455c-9d3a-13bf9885d8e7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:07.767833 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09d3736b-008c-455c-9d3a-13bf9885d8e7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:07.768528 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09d3736b-008c-455c-9d3a-13bf9885d8e7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:07.768997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09d3736b-008c-455c-9d3a-13bf9885d8e7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:07.769416 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-09d3736b-008c-455c-9d3a-13bf9885d8e7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:07.798609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-09d3736b-008c-455c-9d3a-13bf9885d8e7 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045680 Oct 20 13:43:07.799154 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 596/971] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:07 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:07.925795 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-65de1a2a-232b-40d6-96b2-9c7169d6cc3f tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa13086d30>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:07.958632 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-65de1a2a-232b-40d6-96b2-9c7169d6cc3f tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.036524 Oct 20 13:43:07.959367 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 597/972] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:07 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:08.811320 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3980148a-22d9-4517-893b-e0f94f589e02 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:08.814035 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3980148a-22d9-4517-893b-e0f94f589e02 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:08.820463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3980148a-22d9-4517-893b-e0f94f589e02 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:08.820959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3980148a-22d9-4517-893b-e0f94f589e02 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:08.821394 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3980148a-22d9-4517-893b-e0f94f589e02 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:08.822088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3980148a-22d9-4517-893b-e0f94f589e02 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:08.822531 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3980148a-22d9-4517-893b-e0f94f589e02 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:08.822949 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3980148a-22d9-4517-893b-e0f94f589e02 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:08.851223 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3980148a-22d9-4517-893b-e0f94f589e02 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Oct 20 13:43:08.851792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 598/973] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:08 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:08.971400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-83e59348-add2-4887-b50f-642e86956683 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12f52700>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:09.001363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-83e59348-add2-4887-b50f-642e86956683 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.032875 Oct 20 13:43:09.001678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 599/974] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:08 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:09.864390 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-957401c0-8c19-47e6-bb7c-d571dc5868f4 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:09.866634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-957401c0-8c19-47e6-bb7c-d571dc5868f4 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:09.873431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-957401c0-8c19-47e6-bb7c-d571dc5868f4 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:09.873904 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-957401c0-8c19-47e6-bb7c-d571dc5868f4 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:09.874325 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-957401c0-8c19-47e6-bb7c-d571dc5868f4 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:09.875005 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-957401c0-8c19-47e6-bb7c-d571dc5868f4 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:09.875448 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-957401c0-8c19-47e6-bb7c-d571dc5868f4 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:09.875863 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-957401c0-8c19-47e6-bb7c-d571dc5868f4 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:09.906443 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-957401c0-8c19-47e6-bb7c-d571dc5868f4 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046584 Oct 20 13:43:09.906912 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 600/975] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:09 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:10.013662 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-498b99fb-ebdd-4e69-8167-f46868471169 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12e1d430>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:10.042087 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-498b99fb-ebdd-4e69-8167-f46868471169 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 288 microversion: 2.1 time: 0.032235 Oct 20 13:43:10.042638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 601/976] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:10 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 288 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:10.053666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-359467a2-12eb-4089-bc6d-c0830bf25270 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12ec2c10>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:10.108121 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-359467a2-12eb-4089-bc6d-c0830bf25270 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 202 len: 0 microversion: 2.1 time: 0.057919 Oct 20 13:43:10.108686 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 602/977] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Oct 20 13:43:10 2022] DELETE /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 13:43:10.117386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4e764b91-26c0-4606-b465-af1a3699358c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12e7e3a0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:10.165327 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4e764b91-26c0-4606-b465-af1a3699358c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.051582 Oct 20 13:43:10.165910 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 603/978] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:10 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:10.919357 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ead02d42-edcb-4352-8376-b303802f5ebd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:10.922103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-ead02d42-edcb-4352-8376-b303802f5ebd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:10.928735 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ead02d42-edcb-4352-8376-b303802f5ebd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:10.929252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ead02d42-edcb-4352-8376-b303802f5ebd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:10.929692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ead02d42-edcb-4352-8376-b303802f5ebd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:10.930381 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ead02d42-edcb-4352-8376-b303802f5ebd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:10.930844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ead02d42-edcb-4352-8376-b303802f5ebd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:10.931271 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-ead02d42-edcb-4352-8376-b303802f5ebd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:10.959682 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ead02d42-edcb-4352-8376-b303802f5ebd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Oct 20 13:43:10.960243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 604/979] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:10 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:11.178222 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b688bfe7-daf1-49e0-811b-70aacab4c5ff tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12ec20d0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:11.210033 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b688bfe7-daf1-49e0-811b-70aacab4c5ff tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.035645 Oct 20 13:43:11.210602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 605/980] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:11 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:11.972387 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e515b08e-c453-4bc5-945d-d91846fbd298 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:11.975352 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e515b08e-c453-4bc5-945d-d91846fbd298 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:11.981904 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e515b08e-c453-4bc5-945d-d91846fbd298 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:11.982381 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e515b08e-c453-4bc5-945d-d91846fbd298 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:11.982813 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e515b08e-c453-4bc5-945d-d91846fbd298 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:11.983497 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e515b08e-c453-4bc5-945d-d91846fbd298 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:11.983955 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e515b08e-c453-4bc5-945d-d91846fbd298 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:11.984379 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e515b08e-c453-4bc5-945d-d91846fbd298 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:12.012652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e515b08e-c453-4bc5-945d-d91846fbd298 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Oct 20 13:43:12.013233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 606/981] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:11 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:12.223569 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-eb5bf07f-3baa-48ed-8dbb-98ded8c04ada tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12eb3b80>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:12.252136 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-eb5bf07f-3baa-48ed-8dbb-98ded8c04ada tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 200 len: 287 microversion: 2.1 time: 0.033105 Oct 20 13:43:12.252676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 607/982] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:12 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:13.025935 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0aed4443-215d-4b05-85ce-3e361fd78448 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:13.028030 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0aed4443-215d-4b05-85ce-3e361fd78448 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:13.035129 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0aed4443-215d-4b05-85ce-3e361fd78448 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:13.035609 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0aed4443-215d-4b05-85ce-3e361fd78448 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:13.036044 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0aed4443-215d-4b05-85ce-3e361fd78448 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:13.036727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0aed4443-215d-4b05-85ce-3e361fd78448 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:13.037207 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0aed4443-215d-4b05-85ce-3e361fd78448 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:13.037633 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0aed4443-215d-4b05-85ce-3e361fd78448 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:13.069195 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0aed4443-215d-4b05-85ce-3e361fd78448 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047691 Oct 20 13:43:13.069781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 608/983] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:13 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:13.266200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9fbb704d-d71c-4052-bed4-8d5e86dc7561 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12fe4670>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:13.293844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-9fbb704d-d71c-4052-bed4-8d5e86dc7561 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] HTTP exception thrown: Snapshot 61293aec-69c5-4fba-a956-9bc43a40f856 could not be found. Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9fbb704d-d71c-4052-bed4-8d5e86dc7561 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Request method failure captured: Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 HTTP/1.1 Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUVBhBJ7sIkKzoJL6b3jZvWXvfAjsyifRtxFHrf1Xqz9zdGYqRlOxPMFcFOAtTVBTeN_x7S2H0kf6jIkckEheHLnSXmRTmkm2-FEwfFYxmYzmRjrbz3Ds1s8IjTvKLd0CIcgG2EcsH5e7RVAgDaYko9Q4yM8vE0GLPmjqRJ9lrSGkPYE Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 84e31f403c2e461ba6cb8f60d0216201 Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:43:13.304704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 84e31f403c2e461ba6cb8f60d0216201 Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesSnapshotsTestJSON-2115523130-project Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 6804a0ef8eaf49e2b8c02e9d1795d708 Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115523130-project Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Snapshot 61293aec-69c5-4fba-a956-9bc43a40f856 could not be found. Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '61293aec-69c5-4fba-a956-9bc43a40f856'} Oct 20 13:43:13.306652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 61293aec-69c5-4fba-a956-9bc43a40f856 could not be found. (HTTP 404) (Request-ID: req-a1f70345-503f-43a5-a18b-3ee0e363da4c) Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:13.308024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 13:43:13.309500 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 61293aec-69c5-4fba-a956-9bc43a40f856 could not be found. Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 20 13:43:13.311060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 61293aec-69c5-4fba-a956-9bc43a40f856 could not be found. Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 61293aec-69c5-4fba-a956-9bc43a40f856 could not be found. Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9fbb704d-d71c-4052-bed4-8d5e86dc7561 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Returning 404 to user: Snapshot 61293aec-69c5-4fba-a956-9bc43a40f856 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:43:13.312886 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9fbb704d-d71c-4052-bed4-8d5e86dc7561 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856" status: 404 len: 111 microversion: 2.1 time: 0.050225 Oct 20 13:43:13.314024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 609/984] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 20 13:43:13 2022] GET /compute/v2.1/os-snapshots/61293aec-69c5-4fba-a956-9bc43a40f856 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:43:13.321418 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1e7835a0-627b-46b7-97e0-3cda202d09e1 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12fabf70>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:13.393414 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1e7835a0-627b-46b7-97e0-3cda202d09e1 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062" status: 202 len: 0 microversion: 2.1 time: 0.077268 Oct 20 13:43:13.394014 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 610/985] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 20 13:43:13 2022] DELETE /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 13:43:13.402663 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0c86e7f2-bd90-431f-9ef3-aa7d64aebb40 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa13205dc0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:13.459356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0c86e7f2-bd90-431f-9ef3-aa7d64aebb40 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062" status: 200 len: 345 microversion: 2.1 time: 0.060798 Oct 20 13:43:13.460943 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 611/986] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:13 2022] GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:14.081877 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4d2e696e-548f-4339-96f8-0bcdb6ff72d9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:14.084218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4d2e696e-548f-4339-96f8-0bcdb6ff72d9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:14.090666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d2e696e-548f-4339-96f8-0bcdb6ff72d9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:14.091183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d2e696e-548f-4339-96f8-0bcdb6ff72d9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:14.091618 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d2e696e-548f-4339-96f8-0bcdb6ff72d9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:14.092301 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d2e696e-548f-4339-96f8-0bcdb6ff72d9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:14.092748 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d2e696e-548f-4339-96f8-0bcdb6ff72d9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:14.093194 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d2e696e-548f-4339-96f8-0bcdb6ff72d9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:14.123143 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4d2e696e-548f-4339-96f8-0bcdb6ff72d9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046246 Oct 20 13:43:14.123702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 612/987] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 20 13:43:14 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 20 13:43:14.134661 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:14.135176 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:14.140968 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:14.141545 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:14.141928 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:14.142839 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:14.143292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:14.143712 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:14.221861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] HTTP exception thrown: Instance e89b72ca-c19d-4976-97be-086660601e2b is not attached to volume c3db165f-4afb-442c-91f8-f481cc438d4d Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Request method failure captured: Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments/c3db165f-4afb-442c-91f8-f481cc438d4d HTTP/1.1 Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU_Ekf81bPwhH1c05XoDFBDMHbe07CRbYmk0jVHlZuYKXb6U9Rx1fKCX2iOFxvuJ48yzKhk4Ht-IKKUco0IW45P0kt1s3BXxqtkG8_Y3cJAFB9JsDffh8VBcV2x04SZ3TIBF_CTtGPLUo8yvdmzLVV-BHjB-raDnHNMNYr0gGg04res Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: accdb851c01342d49228faa016ff430c Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-TestMinimumBasicScenario-614323431 Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:43:14.225868 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/accdb851c01342d49228faa016ff430c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/accdb851c01342d49228faa016ff430c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/accdb851c01342d49228faa016ff430c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_accdb851c01342d49228faa016ff430c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-TestMinimumBasicScenario-614323431 Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: accdb851c01342d49228faa016ff430c Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-TestMinimumBasicScenario-614323431 Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-TestMinimumBasicScenario-614323431-project Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: ce7ce255f03e4d999ff111ccf3a799d7 Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-TestMinimumBasicScenario-614323431-project Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:43:14.227470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance e89b72ca-c19d-4976-97be-086660601e2b is not attached to volume c3db165f-4afb-442c-91f8-f481cc438d4d Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'server_id': 'e89b72ca-c19d-4976-97be-086660601e2b', 'id': 'c3db165f-4afb-442c-91f8-f481cc438d4d'} Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c3db165f-4afb-442c-91f8-f481cc438d4d. Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:43:14.228331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89b72ca-c19d-4976-97be-086660601e2b is not attached to volume c3db165f-4afb-442c-91f8-f481cc438d4d Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89b72ca-c19d-4976-97be-086660601e2b is not attached to volume c3db165f-4afb-442c-91f8-f481cc438d4d Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.229793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Returning 404 to user: Instance e89b72ca-c19d-4976-97be-086660601e2b is not attached to volume c3db165f-4afb-442c-91f8-f481cc438d4d {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:43:14.230934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f32015b7-4139-4157-8a00-a269242d5a0b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments/c3db165f-4afb-442c-91f8-f481cc438d4d" status: 404 len: 154 microversion: 2.1 time: 0.096378 Oct 20 13:43:14.230934 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 613/988] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 20 13:43:14 2022] DELETE /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b/os-volume_attachments/c3db165f-4afb-442c-91f8-f481cc438d4d => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:43:14.475819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-958e9ac0-5795-4cce-8912-90e5a51c22f8 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12e92820>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:14.510716 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-958e9ac0-5795-4cce-8912-90e5a51c22f8 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] HTTP exception thrown: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-958e9ac0-5795-4cce-8912-90e5a51c22f8 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Request method failure captured: Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 HTTP/1.1 Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUVBhBJ7sIkKzoJL6b3jZvWXvfAjsyifRtxFHrf1Xqz9zdGYqRlOxPMFcFOAtTVBTeN_x7S2H0kf6jIkckEheHLnSXmRTmkm2-FEwfFYxmYzmRjrbz3Ds1s8IjTvKLd0CIcgG2EcsH5e7RVAgDaYko9Q4yM8vE0GLPmjqRJ9lrSGkPYE Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 84e31f403c2e461ba6cb8f60d0216201 Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:43:14.513415 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 84e31f403c2e461ba6cb8f60d0216201 Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesSnapshotsTestJSON-2115523130-project Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 6804a0ef8eaf49e2b8c02e9d1795d708 Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115523130-project Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '641abe3a-73b4-43bb-8d84-20b998934062'} Oct 20 13:43:14.514745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. (HTTP 404) (Request-ID: req-ca356966-34d0-4399-851a-9d5ff37d6b67) Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.515603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 13:43:14.517361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 13:43:14.518523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-958e9ac0-5795-4cce-8912-90e5a51c22f8 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Returning 404 to user: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-958e9ac0-5795-4cce-8912-90e5a51c22f8 tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062" status: 404 len: 109 microversion: 2.1 time: 0.043995 Oct 20 13:43:14.521211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 614/989] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:14 2022] GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:43:14.529427 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-095b8319-334d-49ac-9894-cc4f61d6d6eb tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12eb3ee0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:14.562523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-095b8319-334d-49ac-9894-cc4f61d6d6eb tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] HTTP exception thrown: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-095b8319-334d-49ac-9894-cc4f61d6d6eb tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Request method failure captured: Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: DELETE /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 HTTP/1.1 Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUVBhBJ7sIkKzoJL6b3jZvWXvfAjsyifRtxFHrf1Xqz9zdGYqRlOxPMFcFOAtTVBTeN_x7S2H0kf6jIkckEheHLnSXmRTmkm2-FEwfFYxmYzmRjrbz3Ds1s8IjTvKLd0CIcgG2EcsH5e7RVAgDaYko9Q4yM8vE0GLPmjqRJ9lrSGkPYE Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 84e31f403c2e461ba6cb8f60d0216201 Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:43:14.565058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 84e31f403c2e461ba6cb8f60d0216201 Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesSnapshotsTestJSON-2115523130-project Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 6804a0ef8eaf49e2b8c02e9d1795d708 Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115523130-project Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '641abe3a-73b4-43bb-8d84-20b998934062'} Oct 20 13:43:14.566808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. (HTTP 404) (Request-ID: req-130847a7-2d50-4527-b0eb-b1bc44193dbb) Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.567754 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 13:43:14.569814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 20 13:43:14.571780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-095b8319-334d-49ac-9894-cc4f61d6d6eb tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Returning 404 to user: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-095b8319-334d-49ac-9894-cc4f61d6d6eb tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062" status: 404 len: 109 microversion: 2.1 time: 0.044617 Oct 20 13:43:14.573525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 615/990] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 20 13:43:14 2022] DELETE /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:43:14.575044 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-817969c1-7b59-4a23-a4af-8cdfb1ad655c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Calling method '.version_select at 0x7ffa12e92c10>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:14.604082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-817969c1-7b59-4a23-a4af-8cdfb1ad655c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] HTTP exception thrown: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-817969c1-7b59-4a23-a4af-8cdfb1ad655c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Request method failure captured: Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 HTTP/1.1 Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUVBhBJ7sIkKzoJL6b3jZvWXvfAjsyifRtxFHrf1Xqz9zdGYqRlOxPMFcFOAtTVBTeN_x7S2H0kf6jIkckEheHLnSXmRTmkm2-FEwfFYxmYzmRjrbz3Ds1s8IjTvKLd0CIcgG2EcsH5e7RVAgDaYko9Q4yM8vE0GLPmjqRJ9lrSGkPYE Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 84e31f403c2e461ba6cb8f60d0216201 Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:43:14.606285 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_84e31f403c2e461ba6cb8f60d0216201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 84e31f403c2e461ba6cb8f60d0216201 Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115523130 Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesSnapshotsTestJSON-2115523130-project Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 6804a0ef8eaf49e2b8c02e9d1795d708 Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115523130-project Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '641abe3a-73b4-43bb-8d84-20b998934062'} Oct 20 13:43:14.607879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. (HTTP 404) (Request-ID: req-d51478f8-0c4e-450a-9a87-8e17afb74679) Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.608901 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 13:43:14.610286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 13:43:14.611787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-817969c1-7b59-4a23-a4af-8cdfb1ad655c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] Returning 404 to user: Volume 641abe3a-73b4-43bb-8d84-20b998934062 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:43:14.613710 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-817969c1-7b59-4a23-a4af-8cdfb1ad655c tempest-VolumesSnapshotsTestJSON-2115523130 tempest-VolumesSnapshotsTestJSON-2115523130-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062" status: 404 len: 109 microversion: 2.1 time: 0.036629 Oct 20 13:43:14.615882 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 616/991] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:14 2022] GET /compute/v2.1/os-volumes/641abe3a-73b4-43bb-8d84-20b998934062 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:43:15.407138 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-57b83135-96ac-411b-b926-67b82a9dcb3b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:15.408364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-57b83135-96ac-411b-b926-67b82a9dcb3b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:15.414899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57b83135-96ac-411b-b926-67b82a9dcb3b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:15.415395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57b83135-96ac-411b-b926-67b82a9dcb3b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:15.415827 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57b83135-96ac-411b-b926-67b82a9dcb3b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:15.416708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57b83135-96ac-411b-b926-67b82a9dcb3b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:15.417651 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57b83135-96ac-411b-b926-67b82a9dcb3b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:15.418085 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57b83135-96ac-411b-b926-67b82a9dcb3b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:15.443850 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-57b83135-96ac-411b-b926-67b82a9dcb3b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:43:15.529653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-57b83135-96ac-411b-b926-67b82a9dcb3b tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 204 len: 0 microversion: 2.1 time: 0.129505 Oct 20 13:43:15.531169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 617/992] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:43:15 2022] DELETE /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:43:15.541992 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d32e4183-be3f-4b17-9e90-e136c3faa34e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:15.542763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d32e4183-be3f-4b17-9e90-e136c3faa34e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:15.549601 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32e4183-be3f-4b17-9e90-e136c3faa34e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:15.550169 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32e4183-be3f-4b17-9e90-e136c3faa34e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:15.550670 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32e4183-be3f-4b17-9e90-e136c3faa34e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:15.551422 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32e4183-be3f-4b17-9e90-e136c3faa34e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:15.551951 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32e4183-be3f-4b17-9e90-e136c3faa34e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:15.552536 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d32e4183-be3f-4b17-9e90-e136c3faa34e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:15.701542 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d32e4183-be3f-4b17-9e90-e136c3faa34e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:43:15.711090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d32e4183-be3f-4b17-9e90-e136c3faa34e tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1553 microversion: 2.1 time: 0.173707 Oct 20 13:43:15.712212 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 618/993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:15 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:43:16.160001 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9431248d-622c-4c88-90bd-5f0f8a5b2b37 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] Action: 'create', calling method: .version_select at 0x7ffa12fab1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1253006081", "metadata": {"Type": "work"}}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:43:16.476536 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9431248d-622c-4c88-90bd-5f0f8a5b2b37 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.431509 Oct 20 13:43:16.477200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 619/994] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 20 13:43:16 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 433 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 20 13:43:16.490528 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cb68b1f6-fd19-4963-b119-91069aba9e75 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] Calling method '.version_select at 0x7ffa12f5f3a0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:16.549383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cb68b1f6-fd19-4963-b119-91069aba9e75 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6" status: 200 len: 353 microversion: 2.1 time: 0.062646 Oct 20 13:43:16.550151 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 620/995] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:16 2022] GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:16.734729 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c4d57177-5a52-4fb9-a31d-ac1eb90ab130 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:16.735641 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c4d57177-5a52-4fb9-a31d-ac1eb90ab130 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:16.742128 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4d57177-5a52-4fb9-a31d-ac1eb90ab130 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:16.742810 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4d57177-5a52-4fb9-a31d-ac1eb90ab130 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:16.743240 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4d57177-5a52-4fb9-a31d-ac1eb90ab130 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:16.743925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4d57177-5a52-4fb9-a31d-ac1eb90ab130 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:16.744548 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4d57177-5a52-4fb9-a31d-ac1eb90ab130 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:16.745023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c4d57177-5a52-4fb9-a31d-ac1eb90ab130 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:16.880540 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c4d57177-5a52-4fb9-a31d-ac1eb90ab130 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:43:16.888395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c4d57177-5a52-4fb9-a31d-ac1eb90ab130 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1553 microversion: 2.1 time: 0.157450 Oct 20 13:43:16.888991 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 621/996] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:16 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:43:17.563352 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-702f4455-9b52-4d49-89f1-cd45b4a49ef9 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] Calling method '.version_select at 0x7ffa12baba60>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:17.613360 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-702f4455-9b52-4d49-89f1-cd45b4a49ef9 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6" status: 200 len: 353 microversion: 2.1 time: 0.053246 Oct 20 13:43:17.614103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 622/997] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:17 2022] GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:43:17.911372 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3d1847e7-5c2a-4f51-a404-82b97ab8f8b9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:17.911976 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3d1847e7-5c2a-4f51-a404-82b97ab8f8b9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:17.917882 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d1847e7-5c2a-4f51-a404-82b97ab8f8b9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:17.918356 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d1847e7-5c2a-4f51-a404-82b97ab8f8b9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:17.918781 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d1847e7-5c2a-4f51-a404-82b97ab8f8b9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:17.919455 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d1847e7-5c2a-4f51-a404-82b97ab8f8b9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:17.919898 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d1847e7-5c2a-4f51-a404-82b97ab8f8b9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:17.920316 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d1847e7-5c2a-4f51-a404-82b97ab8f8b9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:18.058832 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3d1847e7-5c2a-4f51-a404-82b97ab8f8b9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:43:18.067049 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3d1847e7-5c2a-4f51-a404-82b97ab8f8b9 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1553 microversion: 2.1 time: 0.159754 Oct 20 13:43:18.067608 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 623/998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:17 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:43:18.629152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-ed49add4-90a6-47ad-bd87-0b90f7037742 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] Calling method '.version_select at 0x7ffa12babee0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:18.679286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-ed49add4-90a6-47ad-bd87-0b90f7037742 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6" status: 200 len: 354 microversion: 2.1 time: 0.054549 Oct 20 13:43:18.679860 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 624/999] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:18 2022] GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:18.692264 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-21474ce3-dc62-445f-b705-8770fcb439ac tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] Calling method '.version_select at 0x7ffa12e7e040>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:18.740459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-21474ce3-dc62-445f-b705-8770fcb439ac tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6" status: 200 len: 354 microversion: 2.1 time: 0.051803 Oct 20 13:43:18.741062 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 625/1000] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:18 2022] GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:18.759366 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f9b5c44f-6750-4882-9964-3398a75d3d3b tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] Calling method '.version_select at 0x7ffa12e92160>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:18.823601 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f9b5c44f-6750-4882-9964-3398a75d3d3b tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6" status: 202 len: 0 microversion: 2.1 time: 0.068171 Oct 20 13:43:18.824155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 626/1001] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 20 13:43:18 2022] DELETE /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 13:43:18.832919 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c75dcf3a-cfba-4eaa-9636-21d25c5959d6 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] Calling method '.version_select at 0x7ffa12e7eca0>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:18.882386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c75dcf3a-cfba-4eaa-9636-21d25c5959d6 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6" status: 200 len: 353 microversion: 2.1 time: 0.053799 Oct 20 13:43:18.883237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 627/1002] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:18 2022] GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:19.090679 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-21b4e320-fcce-4ad3-8e0c-2548d91feb06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:19.091359 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-21b4e320-fcce-4ad3-8e0c-2548d91feb06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:19.098590 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-21b4e320-fcce-4ad3-8e0c-2548d91feb06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:19.099100 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-21b4e320-fcce-4ad3-8e0c-2548d91feb06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:19.099627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-21b4e320-fcce-4ad3-8e0c-2548d91feb06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:19.100403 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-21b4e320-fcce-4ad3-8e0c-2548d91feb06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:19.100940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-21b4e320-fcce-4ad3-8e0c-2548d91feb06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:19.101537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-21b4e320-fcce-4ad3-8e0c-2548d91feb06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:19.255053 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-21b4e320-fcce-4ad3-8e0c-2548d91feb06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:43:19.265144 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-21b4e320-fcce-4ad3-8e0c-2548d91feb06 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1553 microversion: 2.1 time: 0.178033 Oct 20 13:43:19.266265 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 628/1003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:19 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:43:19.838846 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-188b4101-2f3e-4d26-8bd6-d417a155f63a req-48ccac0b-bf77-4246-a905-37d6fb52c723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89b72ca-c19d-4976-97be-086660601e2b", "name": "network-vif-deleted", "tag": "57704c11-9966-4dc7-ba8b-0af092c2b73f"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:43:19.851386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-188b4101-2f3e-4d26-8bd6-d417a155f63a req-48ccac0b-bf77-4246-a905-37d6fb52c723 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:19.851992 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-188b4101-2f3e-4d26-8bd6-d417a155f63a req-48ccac0b-bf77-4246-a905-37d6fb52c723 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:19.852523 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-188b4101-2f3e-4d26-8bd6-d417a155f63a req-48ccac0b-bf77-4246-a905-37d6fb52c723 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:19.865860 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-188b4101-2f3e-4d26-8bd6-d417a155f63a req-48ccac0b-bf77-4246-a905-37d6fb52c723 service nova] Creating event network-vif-deleted:57704c11-9966-4dc7-ba8b-0af092c2b73f for instance e89b72ca-c19d-4976-97be-086660601e2b on hv-cinder-86213 Oct 20 13:43:19.871824 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-188b4101-2f3e-4d26-8bd6-d417a155f63a req-48ccac0b-bf77-4246-a905-37d6fb52c723 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046699 Oct 20 13:43:19.873200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 629/1004] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:43:19.904653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e96ccc84-e058-479c-af5a-cb5e46e24d72 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] Calling method '.version_select at 0x7ffa12e92a60>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:19.959324 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-e96ccc84-e058-479c-af5a-cb5e46e24d72 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] HTTP exception thrown: Volume 76e053b8-0a2f-418d-9861-9b159f835be6 could not be found. Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e96ccc84-e058-479c-af5a-cb5e46e24d72 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] Request method failure captured: Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6 HTTP/1.1 Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUVBz9HilHbfoapLZOeSW34TFdKMvZK_ZGppCL3Srm7NuuqdarHv_jER2tpGU9sZoHtSLaZCyVqKeyHbu8hvT0UQflg4shjjhlT1NidRD0o4604bI5dsiQIdDyttr_gryb-rgYNaKMr2IZk2WEQRiEiLrr4kpoTSnhvswYQVzXXOn1U0 Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 9b0a0dff64c64661a05db93ee8a8fd7d Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesGetTestJSON-1285041196 Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:43:19.961728 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9b0a0dff64c64661a05db93ee8a8fd7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9b0a0dff64c64661a05db93ee8a8fd7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9b0a0dff64c64661a05db93ee8a8fd7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9b0a0dff64c64661a05db93ee8a8fd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesGetTestJSON-1285041196 Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 9b0a0dff64c64661a05db93ee8a8fd7d Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesGetTestJSON-1285041196 Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesGetTestJSON-1285041196-project Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 704f8cb826214bc78dd49d0962f1417a Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesGetTestJSON-1285041196-project Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Volume 76e053b8-0a2f-418d-9861-9b159f835be6 could not be found. Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': '76e053b8-0a2f-418d-9861-9b159f835be6'} Oct 20 13:43:19.963407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 76e053b8-0a2f-418d-9861-9b159f835be6 could not be found. (HTTP 404) (Request-ID: req-fb5cfd30-e16e-47a3-8b5b-ed2a1d3251a3) Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:19.964370 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 13:43:19.965789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 76e053b8-0a2f-418d-9861-9b159f835be6 could not be found. Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 13:43:19.967126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 76e053b8-0a2f-418d-9861-9b159f835be6 could not be found. Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 76e053b8-0a2f-418d-9861-9b159f835be6 could not be found. Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e96ccc84-e058-479c-af5a-cb5e46e24d72 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] Returning 404 to user: Volume 76e053b8-0a2f-418d-9861-9b159f835be6 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e96ccc84-e058-479c-af5a-cb5e46e24d72 tempest-VolumesGetTestJSON-1285041196 tempest-VolumesGetTestJSON-1285041196-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6" status: 404 len: 109 microversion: 2.1 time: 0.067573 Oct 20 13:43:19.968470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 630/1005] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 20 13:43:19 2022] GET /compute/v2.1/os-volumes/76e053b8-0a2f-418d-9861-9b159f835be6 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 13:43:20.289827 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:20.290551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:20.298444 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:20.299435 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:20.299944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:20.300711 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:20.301371 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:20.301921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:20.335207 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:20.335596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:20.336023 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:20.336459 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lazy-loading 'fault' on Instance uuid e89b72ca-c19d-4976-97be-086660601e2b {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:43:20.379700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:43:20.387534 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-cd35db85-f077-438e-9fc6-e398302a09cd tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1348 microversion: 2.1 time: 0.101490 Oct 20 13:43:20.388091 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 631/1006] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:20 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:43:21.412097 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:21.412712 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:21.414880 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:43:21.420194 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:21.420680 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:21.421146 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:21.421966 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:21.422425 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:21.423439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:21.427022 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:43:21.459681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:21.460216 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:21.460674 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:21.461152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lazy-loading 'fault' on Instance uuid e89b72ca-c19d-4976-97be-086660601e2b {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:43:21.507445 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:43:21.515861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e9b81fa2-5837-4ebd-829d-facde9181a6f tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1348 microversion: 2.1 time: 0.108170 Oct 20 13:43:21.516473 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 632/1007] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:21 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1348 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:43:22.539038 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:22.539739 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:22.546449 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:22.546964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:22.547440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:22.548848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:22.549434 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:22.549865 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:22.585809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:22.600183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:22.600183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:22.600183 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lazy-loading 'fault' on Instance uuid e89b72ca-c19d-4976-97be-086660601e2b {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:43:22.632532 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7ce255f03e4d999ff111ccf3a799d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdb851c01342d49228faa016ff430c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:43:22.644642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d224e8f1-7f76-4ec3-9af0-870d8bbb8c67 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 200 len: 1348 microversion: 2.1 time: 0.109272 Oct 20 13:43:22.646245 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 633/1008] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:22 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 1348 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:43:23.669037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:23.669681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] [instance: e89b72ca-c19d-4976-97be-086660601e2b] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:23.676605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:23.677177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:23.677630 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:23.678410 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:23.678899 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:23.679362 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:23.696274 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] HTTP exception thrown: Instance e89b72ca-c19d-4976-97be-086660601e2b could not be found. Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Request method failure captured: Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b HTTP/1.1 Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUU_Ekf81bPwhH1c05XoDFBDMHbe07CRbYmk0jVHlZuYKXb6U9Rx1fKCX2iOFxvuJ48yzKhk4Ht-IKKUco0IW45P0kt1s3BXxqtkG8_Y3cJAFB9JsDffh8VBcV2x04SZ3TIBF_CTtGPLUo8yvdmzLVV-BHjB-raDnHNMNYr0gGg04res Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: accdb851c01342d49228faa016ff430c Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-TestMinimumBasicScenario-614323431 Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:43:23.697838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/accdb851c01342d49228faa016ff430c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/accdb851c01342d49228faa016ff430c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/accdb851c01342d49228faa016ff430c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_accdb851c01342d49228faa016ff430c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-TestMinimumBasicScenario-614323431 Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: accdb851c01342d49228faa016ff430c Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-TestMinimumBasicScenario-614323431 Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-TestMinimumBasicScenario-614323431-project Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: ce7ce255f03e4d999ff111ccf3a799d7 Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-TestMinimumBasicScenario-614323431-project Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance e89b72ca-c19d-4976-97be-086660601e2b could not be found. Oct 20 13:43:23.699463 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'e89b72ca-c19d-4976-97be-086660601e2b'} Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e89b72ca-c19d-4976-97be-086660601e2b could not be found. Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:43:23.700364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89b72ca-c19d-4976-97be-086660601e2b could not be found. Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89b72ca-c19d-4976-97be-086660601e2b could not be found. Oct 20 13:43:23.701878 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:43:23.703211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Returning 404 to user: Instance e89b72ca-c19d-4976-97be-086660601e2b could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:43:23.703211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d5d81d10-c3a4-4370-bf62-32f85f69a32a tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b" status: 404 len: 111 microversion: 2.1 time: 0.034551 Oct 20 13:43:23.703211 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 634/1009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:23 2022] GET /compute/v2.1/servers/e89b72ca-c19d-4976-97be-086660601e2b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:43:23.709290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-505f8c8f-d004-4061-afd4-a7a3d3369265 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] Calling method '.version_select at 0x7ffa12e6ac10>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:23.734602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-505f8c8f-d004-4061-afd4-a7a3d3369265 tempest-TestMinimumBasicScenario-614323431 tempest-TestMinimumBasicScenario-614323431-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1810721168" status: 202 len: 0 microversion: 2.1 time: 0.028988 Oct 20 13:43:23.735220 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 635/1010] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 20 13:43:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1810721168 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 13:43:56.009240 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=17 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:43:56.010084 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:43:56.014198 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-20822185", "imageRef": "43fd409e-76df-4d4d-a07d-0dc7154ece5c", "flavorRef": "452"}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:43:56.072241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.network.neutron [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] validate_networks() for None {{(pid=125448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:43:56.428517 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Flavor limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:43:56.428968 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Image limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:43:56.429440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Flavor pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:43:56.429850 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Image pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:43:56.430271 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:43:56.441294 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:56.441773 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:56.442208 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:56.442936 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:56.443384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:56.443807 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:56.463657 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Getting quotas for project 29dff2585070499ea1cdaa39016417d0. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:43:56.467989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Getting quotas for user 69c1e55e00094866897bc509ae65c6e5 and project 29dff2585070499ea1cdaa39016417d0. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:43:56.479518 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Going to run 1 instances... {{(pid=125448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:43:56.482950 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43fd409e-76df-4d4d-a07d-0dc7154ece5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:43:56.539860 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3d828e0e-df38-45c3-9587-3bfbb16b93d3 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531906 Oct 20 13:43:56.540851 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 636/1011] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:43:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 13:43:56.553447 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9db0b63b-9e36-4339-a87f-2844b6cfcc11 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:56.554296 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9db0b63b-9e36-4339-a87f-2844b6cfcc11 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:56.633146 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9db0b63b-9e36-4339-a87f-2844b6cfcc11 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:43:56.642775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9db0b63b-9e36-4339-a87f-2844b6cfcc11 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1213 microversion: 2.1 time: 0.094549 Oct 20 13:43:56.643780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 637/1012] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:56 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:43:57.666959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5193c620-364a-4df3-aab7-40de3e2f3bc6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:57.668248 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5193c620-364a-4df3-aab7-40de3e2f3bc6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:57.676364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5193c620-364a-4df3-aab7-40de3e2f3bc6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:57.677012 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5193c620-364a-4df3-aab7-40de3e2f3bc6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:57.677453 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5193c620-364a-4df3-aab7-40de3e2f3bc6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:57.678155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5193c620-364a-4df3-aab7-40de3e2f3bc6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:57.678612 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5193c620-364a-4df3-aab7-40de3e2f3bc6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:57.679040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5193c620-364a-4df3-aab7-40de3e2f3bc6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:57.787865 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5193c620-364a-4df3-aab7-40de3e2f3bc6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:43:57.803426 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5193c620-364a-4df3-aab7-40de3e2f3bc6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1265 microversion: 2.1 time: 0.140311 Oct 20 13:43:57.804237 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 638/1013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:57 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:43:58.831170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-978bafdf-b814-4110-a710-e4f6106550c4 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:43:58.832497 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-978bafdf-b814-4110-a710-e4f6106550c4 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:43:58.841678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-978bafdf-b814-4110-a710-e4f6106550c4 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:58.842391 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-978bafdf-b814-4110-a710-e4f6106550c4 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:58.843021 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-978bafdf-b814-4110-a710-e4f6106550c4 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:58.845029 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-978bafdf-b814-4110-a710-e4f6106550c4 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:58.845699 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-978bafdf-b814-4110-a710-e4f6106550c4 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:58.846321 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-978bafdf-b814-4110-a710-e4f6106550c4 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:58.965925 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-978bafdf-b814-4110-a710-e4f6106550c4 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:43:58.975866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-978bafdf-b814-4110-a710-e4f6106550c4 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1271 microversion: 2.1 time: 0.151533 Oct 20 13:43:58.976469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 639/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:43:58 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:43:59.950440 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-6116a775-4741-4e9e-940b-79f04b82d09d req-f18c91f4-73e2-45d1-8a05-05cd9c6e4f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f157145e-ca0a-418f-a843-2662a63b50bf", "tag": "39fc983a-71f8-4c89-a812-ea8a2613e710"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:43:59.965560 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6116a775-4741-4e9e-940b-79f04b82d09d req-f18c91f4-73e2-45d1-8a05-05cd9c6e4f47 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:43:59.967059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6116a775-4741-4e9e-940b-79f04b82d09d req-f18c91f4-73e2-45d1-8a05-05cd9c6e4f47 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:43:59.967821 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6116a775-4741-4e9e-940b-79f04b82d09d req-f18c91f4-73e2-45d1-8a05-05cd9c6e4f47 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:43:59.988894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-6116a775-4741-4e9e-940b-79f04b82d09d req-f18c91f4-73e2-45d1-8a05-05cd9c6e4f47 service nova] Creating event network-changed:39fc983a-71f8-4c89-a812-ea8a2613e710 for instance f157145e-ca0a-418f-a843-2662a63b50bf on hv-cinder-86213 Oct 20 13:43:59.997228 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-6116a775-4741-4e9e-940b-79f04b82d09d req-f18c91f4-73e2-45d1-8a05-05cd9c6e4f47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054375 Oct 20 13:43:59.999696 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 640/1015] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:44:00.021040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-990e98c2-241e-49c0-aab8-0025f89aed4a tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:00.022234 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-990e98c2-241e-49c0-aab8-0025f89aed4a tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:00.029347 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-990e98c2-241e-49c0-aab8-0025f89aed4a tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:00.030801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-990e98c2-241e-49c0-aab8-0025f89aed4a tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:00.032617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-990e98c2-241e-49c0-aab8-0025f89aed4a tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:00.033733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-990e98c2-241e-49c0-aab8-0025f89aed4a tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:00.034619 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-990e98c2-241e-49c0-aab8-0025f89aed4a tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:00.035264 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-990e98c2-241e-49c0-aab8-0025f89aed4a tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:00.536155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-990e98c2-241e-49c0-aab8-0025f89aed4a tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:00.546649 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-990e98c2-241e-49c0-aab8-0025f89aed4a tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1313 microversion: 2.1 time: 0.535067 Oct 20 13:44:00.548070 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 641/1016] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:00 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:44:01.571566 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-67da3e44-7192-4c25-97bd-3034f3eebe9e tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:01.574391 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-67da3e44-7192-4c25-97bd-3034f3eebe9e tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:01.584498 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67da3e44-7192-4c25-97bd-3034f3eebe9e tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:01.585012 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67da3e44-7192-4c25-97bd-3034f3eebe9e tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:01.585625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67da3e44-7192-4c25-97bd-3034f3eebe9e tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:01.586439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67da3e44-7192-4c25-97bd-3034f3eebe9e tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:01.586892 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67da3e44-7192-4c25-97bd-3034f3eebe9e tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:01.587307 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-67da3e44-7192-4c25-97bd-3034f3eebe9e tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:01.852824 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-67da3e44-7192-4c25-97bd-3034f3eebe9e tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:01.861525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-67da3e44-7192-4c25-97bd-3034f3eebe9e tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1313 microversion: 2.1 time: 0.293870 Oct 20 13:44:01.881000 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 642/1017] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:01 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:44:02.889961 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0a132187-c1e6-4c1e-8c73-416dc34bc12b tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:02.891456 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0a132187-c1e6-4c1e-8c73-416dc34bc12b tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:02.898539 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a132187-c1e6-4c1e-8c73-416dc34bc12b tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:02.899597 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a132187-c1e6-4c1e-8c73-416dc34bc12b tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:02.900221 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a132187-c1e6-4c1e-8c73-416dc34bc12b tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:02.901431 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a132187-c1e6-4c1e-8c73-416dc34bc12b tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:02.902039 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a132187-c1e6-4c1e-8c73-416dc34bc12b tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:02.902622 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0a132187-c1e6-4c1e-8c73-416dc34bc12b tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:03.191485 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0a132187-c1e6-4c1e-8c73-416dc34bc12b tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:03.200504 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0a132187-c1e6-4c1e-8c73-416dc34bc12b tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1313 microversion: 2.1 time: 0.314385 Oct 20 13:44:03.205172 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 643/1018] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:02 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:04.224242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-eafd40a6-70d0-450d-afa9-2263d05550c6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:04.224809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-eafd40a6-70d0-450d-afa9-2263d05550c6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:04.236922 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eafd40a6-70d0-450d-afa9-2263d05550c6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:04.238519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eafd40a6-70d0-450d-afa9-2263d05550c6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:04.239113 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eafd40a6-70d0-450d-afa9-2263d05550c6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:04.240957 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eafd40a6-70d0-450d-afa9-2263d05550c6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:04.241579 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eafd40a6-70d0-450d-afa9-2263d05550c6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:04.242382 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-eafd40a6-70d0-450d-afa9-2263d05550c6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:04.567200 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-eafd40a6-70d0-450d-afa9-2263d05550c6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:04.593175 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-eafd40a6-70d0-450d-afa9-2263d05550c6 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1313 microversion: 2.1 time: 0.372189 Oct 20 13:44:04.595407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 644/1019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:04 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:44:05.621902 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-7cf1301b-75f1-4861-ad6f-c0b337a6c869 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:05.624107 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-7cf1301b-75f1-4861-ad6f-c0b337a6c869 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:05.634239 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cf1301b-75f1-4861-ad6f-c0b337a6c869 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:05.635177 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cf1301b-75f1-4861-ad6f-c0b337a6c869 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:05.635819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cf1301b-75f1-4861-ad6f-c0b337a6c869 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:05.637954 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cf1301b-75f1-4861-ad6f-c0b337a6c869 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:05.638853 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cf1301b-75f1-4861-ad6f-c0b337a6c869 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:05.639580 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-7cf1301b-75f1-4861-ad6f-c0b337a6c869 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:06.161215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-7cf1301b-75f1-4861-ad6f-c0b337a6c869 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:06.168984 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-7cf1301b-75f1-4861-ad6f-c0b337a6c869 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1313 microversion: 2.1 time: 0.552819 Oct 20 13:44:06.169631 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 645/1020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:05 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:44:06.328940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-c8ab76f3-4993-4931-826d-f2ae699df08d req-2d45dbf5-31c6-47ce-a95c-376271527de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f157145e-ca0a-418f-a843-2662a63b50bf", "name": "network-vif-plugged", "status": "completed", "tag": "39fc983a-71f8-4c89-a812-ea8a2613e710"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:44:06.340593 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-c8ab76f3-4993-4931-826d-f2ae699df08d req-2d45dbf5-31c6-47ce-a95c-376271527de6 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:06.341441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-c8ab76f3-4993-4931-826d-f2ae699df08d req-2d45dbf5-31c6-47ce-a95c-376271527de6 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:06.342205 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-c8ab76f3-4993-4931-826d-f2ae699df08d req-2d45dbf5-31c6-47ce-a95c-376271527de6 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:06.362877 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-c8ab76f3-4993-4931-826d-f2ae699df08d req-2d45dbf5-31c6-47ce-a95c-376271527de6 service nova] Creating event network-vif-plugged:39fc983a-71f8-4c89-a812-ea8a2613e710 for instance f157145e-ca0a-418f-a843-2662a63b50bf on hv-cinder-86213 Oct 20 13:44:06.368685 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-c8ab76f3-4993-4931-826d-f2ae699df08d req-2d45dbf5-31c6-47ce-a95c-376271527de6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045330 Oct 20 13:44:06.369883 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 646/1021] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:44:07.191399 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:07.192817 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=8 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:07.197494 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e1bd2f8a-8ca2-4ee8-b02f-191f90b2cfcd tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:07.199045 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e1bd2f8a-8ca2-4ee8-b02f-191f90b2cfcd tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:07.212475 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1bd2f8a-8ca2-4ee8-b02f-191f90b2cfcd tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:07.213569 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1bd2f8a-8ca2-4ee8-b02f-191f90b2cfcd tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:07.214709 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1bd2f8a-8ca2-4ee8-b02f-191f90b2cfcd tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:07.216775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1bd2f8a-8ca2-4ee8-b02f-191f90b2cfcd tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:07.225923 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1bd2f8a-8ca2-4ee8-b02f-191f90b2cfcd tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:07.226545 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e1bd2f8a-8ca2-4ee8-b02f-191f90b2cfcd tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:07.434691 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e1bd2f8a-8ca2-4ee8-b02f-191f90b2cfcd tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:07.454907 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e1bd2f8a-8ca2-4ee8-b02f-191f90b2cfcd tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1313 microversion: 2.1 time: 0.263880 Oct 20 13:44:07.456208 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 647/1022] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:07 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:44:08.494767 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f14702f6-4e5c-400b-b7a9-b9404ad4f7cb tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:08.497460 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f14702f6-4e5c-400b-b7a9-b9404ad4f7cb tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:08.519544 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f14702f6-4e5c-400b-b7a9-b9404ad4f7cb tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:08.520344 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f14702f6-4e5c-400b-b7a9-b9404ad4f7cb tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:08.521032 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f14702f6-4e5c-400b-b7a9-b9404ad4f7cb tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:08.522151 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f14702f6-4e5c-400b-b7a9-b9404ad4f7cb tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:08.522830 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f14702f6-4e5c-400b-b7a9-b9404ad4f7cb tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:08.523472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f14702f6-4e5c-400b-b7a9-b9404ad4f7cb tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:08.724708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f14702f6-4e5c-400b-b7a9-b9404ad4f7cb tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:08.737984 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f14702f6-4e5c-400b-b7a9-b9404ad4f7cb tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1463 microversion: 2.1 time: 0.259120 Oct 20 13:44:08.738988 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 648/1023] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:08 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1463 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:44:08.804604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6ae8c1b4-b26b-49e7-be97-7f61bee527d0 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:08.806040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6ae8c1b4-b26b-49e7-be97-7f61bee527d0 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:08.813152 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ae8c1b4-b26b-49e7-be97-7f61bee527d0 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:08.813995 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ae8c1b4-b26b-49e7-be97-7f61bee527d0 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:08.814987 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ae8c1b4-b26b-49e7-be97-7f61bee527d0 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:08.816397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ae8c1b4-b26b-49e7-be97-7f61bee527d0 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:08.817626 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ae8c1b4-b26b-49e7-be97-7f61bee527d0 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:08.818160 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6ae8c1b4-b26b-49e7-be97-7f61bee527d0 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:08.851314 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6ae8c1b4-b26b-49e7-be97-7f61bee527d0 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:44:08.958869 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-6ae8c1b4-b26b-49e7-be97-7f61bee527d0 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 204 len: 0 microversion: 2.1 time: 0.157825 Oct 20 13:44:08.959676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 649/1024] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:44:08 2022] DELETE /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 13:44:08.969465 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-adf05958-9d33-4530-9098-5b25aab96744 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:08.970175 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-adf05958-9d33-4530-9098-5b25aab96744 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:08.976116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-adf05958-9d33-4530-9098-5b25aab96744 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:08.976601 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-adf05958-9d33-4530-9098-5b25aab96744 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:08.977077 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-adf05958-9d33-4530-9098-5b25aab96744 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:08.977777 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-adf05958-9d33-4530-9098-5b25aab96744 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:08.978227 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-adf05958-9d33-4530-9098-5b25aab96744 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:08.978648 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-adf05958-9d33-4530-9098-5b25aab96744 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:09.121608 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-adf05958-9d33-4530-9098-5b25aab96744 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:09.130126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-adf05958-9d33-4530-9098-5b25aab96744 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1469 microversion: 2.1 time: 0.165186 Oct 20 13:44:09.130702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 650/1025] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:08 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:09.339398 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e5080a1f-a4b0-44c1-b43d-74a8a41d389a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Action: 'create', calling method: .version_select at 0x7ffa12f3e820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1174838333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0rs3zr7jL+2cmJjwXqSBuxWFMaK1daC6zkzTL6KjBZprXphzFsU/LrvvfQn3/Bv4aw7gg10O6Yw6Lz16ItCz+EoXP2PHlMXyX1+TjUHVUb0StXZN6i/Wa7UwZJEGwv0w=="}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:44:09.355214 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-e5080a1f-a4b0-44c1-b43d-74a8a41d389a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Getting quotas for project 2de4676254c14b55aa2b7765255c69c9. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:44:09.359117 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-e5080a1f-a4b0-44c1-b43d-74a8a41d389a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Getting quotas for user 7f7a6b4a92ff4232843913a1dbd7f1c4 and project 2de4676254c14b55aa2b7765255c69c9. Resources: {'key_pairs'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:44:09.380654 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e5080a1f-a4b0-44c1-b43d-74a8a41d389a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.248982 Oct 20 13:44:09.381275 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 651/1026] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 20 13:44:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:44:10.154225 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e34ef596-12ba-434a-a8cd-edebf18c6042 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:10.155615 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e34ef596-12ba-434a-a8cd-edebf18c6042 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:10.164035 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e34ef596-12ba-434a-a8cd-edebf18c6042 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:10.164727 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e34ef596-12ba-434a-a8cd-edebf18c6042 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:10.165065 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e34ef596-12ba-434a-a8cd-edebf18c6042 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:10.166024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e34ef596-12ba-434a-a8cd-edebf18c6042 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:10.166443 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e34ef596-12ba-434a-a8cd-edebf18c6042 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:10.167257 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e34ef596-12ba-434a-a8cd-edebf18c6042 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:10.360124 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e34ef596-12ba-434a-a8cd-edebf18c6042 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:10.370323 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e34ef596-12ba-434a-a8cd-edebf18c6042 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1469 microversion: 2.1 time: 0.220919 Oct 20 13:44:10.371507 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 652/1027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:10 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:10.960678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-36c0e9e0-7587-4d2b-868d-833421185fef req-b599f3eb-1416-4c3e-b203-d38c9c5d0188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f157145e-ca0a-418f-a843-2662a63b50bf", "name": "network-vif-deleted", "tag": "39fc983a-71f8-4c89-a812-ea8a2613e710"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:44:10.974517 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-36c0e9e0-7587-4d2b-868d-833421185fef req-b599f3eb-1416-4c3e-b203-d38c9c5d0188 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:10.975791 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-36c0e9e0-7587-4d2b-868d-833421185fef req-b599f3eb-1416-4c3e-b203-d38c9c5d0188 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:10.976470 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-36c0e9e0-7587-4d2b-868d-833421185fef req-b599f3eb-1416-4c3e-b203-d38c9c5d0188 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:11.009760 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-36c0e9e0-7587-4d2b-868d-833421185fef req-b599f3eb-1416-4c3e-b203-d38c9c5d0188 service nova] Creating event network-vif-deleted:39fc983a-71f8-4c89-a812-ea8a2613e710 for instance f157145e-ca0a-418f-a843-2662a63b50bf on hv-cinder-86213 Oct 20 13:44:11.017457 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-36c0e9e0-7587-4d2b-868d-833421185fef req-b599f3eb-1416-4c3e-b203-d38c9c5d0188 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060735 Oct 20 13:44:11.018810 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 653/1028] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:44:11.393620 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:11.394505 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:11.401164 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:11.401646 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:11.402073 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:11.402811 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:11.403255 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:11.403752 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:11.438813 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:11.439290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:11.439715 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:11.440154 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lazy-loading 'fault' on Instance uuid f157145e-ca0a-418f-a843-2662a63b50bf {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:44:11.494432 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c1e55e00094866897bc509ae65c6e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dff2585070499ea1cdaa39016417d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:11.504269 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5ee7523d-d696-421f-8bc3-661d09072fa8 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 200 len: 1303 microversion: 2.1 time: 0.114771 Oct 20 13:44:11.505516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 654/1029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:11 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:12.527982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:12.528648 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] [instance: f157145e-ca0a-418f-a843-2662a63b50bf] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:12.535328 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:12.535816 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:12.536243 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:12.536941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:12.537388 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:12.537804 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:12.541757 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:12.552772 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] HTTP exception thrown: Instance f157145e-ca0a-418f-a843-2662a63b50bf could not be found. Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Request method failure captured: Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf HTTP/1.1 Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUVCasGGUAU-Zlm8Ir25YlPdnvcXR4ROcOSlAltPqaQPWL-QMFN7gPORqI5SmzRQxLBw_kRbL3qg3MYsl2k02G41XtnyU2BtAKcQdu3H-ejCz7q2uoj3r_F7a7lkQ5iPOcDKEHqi8BbtB8DMbi7ICsczQ3TnSg6JI-JJum12XfgJehYI Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 29dff2585070499ea1cdaa39016417d0 Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-VolumesNegativeTest-994989026 Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:44:12.554509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29dff2585070499ea1cdaa39016417d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29dff2585070499ea1cdaa39016417d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29dff2585070499ea1cdaa39016417d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29dff2585070499ea1cdaa39016417d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-VolumesNegativeTest-994989026 Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 29dff2585070499ea1cdaa39016417d0 Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-VolumesNegativeTest-994989026 Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-VolumesNegativeTest-994989026-project Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 69c1e55e00094866897bc509ae65c6e5 Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-VolumesNegativeTest-994989026-project Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance f157145e-ca0a-418f-a843-2662a63b50bf could not be found. Oct 20 13:44:12.556233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'f157145e-ca0a-418f-a843-2662a63b50bf'} Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f157145e-ca0a-418f-a843-2662a63b50bf could not be found. Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:44:12.557363 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f157145e-ca0a-418f-a843-2662a63b50bf could not be found. Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f157145e-ca0a-418f-a843-2662a63b50bf could not be found. Oct 20 13:44:12.559082 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:44:12.560501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] Returning 404 to user: Instance f157145e-ca0a-418f-a843-2662a63b50bf could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:44:12.560501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d1dcf753-fa09-4846-929f-0d22f662eb84 tempest-VolumesNegativeTest-994989026 tempest-VolumesNegativeTest-994989026-project] 10.222.0.23 "GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf" status: 404 len: 111 microversion: 2.1 time: 0.031907 Oct 20 13:44:12.560501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 655/1030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:12 2022] GET /compute/v2.1/servers/f157145e-ca0a-418f-a843-2662a63b50bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:44:32.221574 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-117060883", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1174838333", "security_groups": [{"name": "tempest-secgroup-smoke-932800917"}], "networks": [{"uuid": "0f592744-30d0-4c9f-8d1d-d169c26122c1"}], "block_device_mapping_v2": [{"uuid": "97555150-02bf-4da1-a876-de4b978a4122", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:44:32.232519 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=4 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:32.233242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:32.345488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.network.neutron [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] validate_networks() for [('0f592744-30d0-4c9f-8d1d-d169c26122c1', None, None, None, None, None)] {{(pid=125448) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 13:44:32.727490 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Flavor limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 13:44:32.727916 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Image limits 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 13:44:32.728389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Flavor pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 13:44:32.728806 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Image pref 0:0:0 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 13:44:32.729261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.virt.hardware [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125448) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 13:44:32.738327 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:32.738808 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:32.739495 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:32.740233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:32.740688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:32.741133 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:32.758942 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Getting quotas for project 2de4676254c14b55aa2b7765255c69c9. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 13:44:32.763287 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.quota [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Getting quotas for user 7f7a6b4a92ff4232843913a1dbd7f1c4 and project 2de4676254c14b55aa2b7765255c69c9. Resources: {'instances', 'ram', 'cores'} {{(pid=125448) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 13:44:32.830719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Going to run 1 instances... {{(pid=125448) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 13:44:32.832833 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97555150-02bf-4da1-a876-de4b978a4122',volume_size=None,volume_type=None)] {{(pid=125448) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 13:44:32.964378 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2f9bc489-27e2-4aed-b83d-aaf897c63bdb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746843 Oct 20 13:44:32.965118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 656/1031] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 20 13:44:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 13:44:32.977838 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-49d0c7e8-6622-4167-9287-6bc4733891b7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:32.978533 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-49d0c7e8-6622-4167-9287-6bc4733891b7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:33.039396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-49d0c7e8-6622-4167-9287-6bc4733891b7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:33.049944 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-49d0c7e8-6622-4167-9287-6bc4733891b7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1088 microversion: 2.1 time: 0.076613 Oct 20 13:44:33.050759 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 657/1032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:32 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:34.073497 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8f8a4462-98a9-4891-b2ee-637a04d988c1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:34.074209 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8f8a4462-98a9-4891-b2ee-637a04d988c1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:34.086858 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f8a4462-98a9-4891-b2ee-637a04d988c1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:34.087278 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f8a4462-98a9-4891-b2ee-637a04d988c1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:34.087743 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f8a4462-98a9-4891-b2ee-637a04d988c1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:34.088658 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f8a4462-98a9-4891-b2ee-637a04d988c1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:34.089294 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f8a4462-98a9-4891-b2ee-637a04d988c1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:34.089664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8f8a4462-98a9-4891-b2ee-637a04d988c1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:34.172692 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8f8a4462-98a9-4891-b2ee-637a04d988c1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:34.181407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8f8a4462-98a9-4891-b2ee-637a04d988c1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1194 microversion: 2.1 time: 0.111787 Oct 20 13:44:34.182197 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 658/1033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:34 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1194 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:35.206985 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-967973c2-627c-474f-a23c-b6802a4e92a5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:35.208404 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-967973c2-627c-474f-a23c-b6802a4e92a5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:35.215744 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-967973c2-627c-474f-a23c-b6802a4e92a5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:35.216298 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-967973c2-627c-474f-a23c-b6802a4e92a5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:35.216732 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-967973c2-627c-474f-a23c-b6802a4e92a5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:35.217531 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-967973c2-627c-474f-a23c-b6802a4e92a5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:35.219192 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-967973c2-627c-474f-a23c-b6802a4e92a5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:35.219677 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-967973c2-627c-474f-a23c-b6802a4e92a5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:35.439493 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-967973c2-627c-474f-a23c-b6802a4e92a5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:35.447501 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-967973c2-627c-474f-a23c-b6802a4e92a5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.246210 Oct 20 13:44:35.448158 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 659/1034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:35 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:35.585510 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-e64a8289-8e10-4d94-804c-740627d1f0fa req-504b597c-e92a-4c2f-ae1c-98bdea67fe1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c93d82ad-cde4-4b8f-84c3-2a3891ebd707", "tag": "c60610d5-8cbd-4e4d-91b4-6eab27fabd56"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:44:35.597385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-e64a8289-8e10-4d94-804c-740627d1f0fa req-504b597c-e92a-4c2f-ae1c-98bdea67fe1b service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:35.597991 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-e64a8289-8e10-4d94-804c-740627d1f0fa req-504b597c-e92a-4c2f-ae1c-98bdea67fe1b service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:35.598664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-e64a8289-8e10-4d94-804c-740627d1f0fa req-504b597c-e92a-4c2f-ae1c-98bdea67fe1b service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:35.610163 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-e64a8289-8e10-4d94-804c-740627d1f0fa req-504b597c-e92a-4c2f-ae1c-98bdea67fe1b service nova] Creating event network-changed:c60610d5-8cbd-4e4d-91b4-6eab27fabd56 for instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 on hv-cinder-86213 Oct 20 13:44:35.615909 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-e64a8289-8e10-4d94-804c-740627d1f0fa req-504b597c-e92a-4c2f-ae1c-98bdea67fe1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034037 Oct 20 13:44:35.616685 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 660/1035] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:44:36.472142 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-03448014-c8c5-44ab-bc49-9ea2a4a11dca tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:36.472897 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-03448014-c8c5-44ab-bc49-9ea2a4a11dca tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:36.479487 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-03448014-c8c5-44ab-bc49-9ea2a4a11dca tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:36.479968 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-03448014-c8c5-44ab-bc49-9ea2a4a11dca tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:36.480404 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-03448014-c8c5-44ab-bc49-9ea2a4a11dca tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:36.481126 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-03448014-c8c5-44ab-bc49-9ea2a4a11dca tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:36.481629 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-03448014-c8c5-44ab-bc49-9ea2a4a11dca tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:36.482141 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-03448014-c8c5-44ab-bc49-9ea2a4a11dca tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:36.703291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-03448014-c8c5-44ab-bc49-9ea2a4a11dca tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:36.711150 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-03448014-c8c5-44ab-bc49-9ea2a4a11dca tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.243716 Oct 20 13:44:36.711722 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 661/1036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:36 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:37.734836 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-de9eb5c5-6d26-4164-b0f8-35fe2dfee192 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:37.735441 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-de9eb5c5-6d26-4164-b0f8-35fe2dfee192 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:37.742159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de9eb5c5-6d26-4164-b0f8-35fe2dfee192 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:37.742638 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de9eb5c5-6d26-4164-b0f8-35fe2dfee192 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:37.743075 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de9eb5c5-6d26-4164-b0f8-35fe2dfee192 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:37.744148 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de9eb5c5-6d26-4164-b0f8-35fe2dfee192 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:37.744275 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de9eb5c5-6d26-4164-b0f8-35fe2dfee192 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:37.744604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-de9eb5c5-6d26-4164-b0f8-35fe2dfee192 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:37.887473 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-de9eb5c5-6d26-4164-b0f8-35fe2dfee192 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:37.895902 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-de9eb5c5-6d26-4164-b0f8-35fe2dfee192 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.165300 Oct 20 13:44:37.896480 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 662/1037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:37 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:38.919036 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b82a282b-ca9a-4a26-8baf-13975c64e4a7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:38.919720 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b82a282b-ca9a-4a26-8baf-13975c64e4a7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:38.926481 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b82a282b-ca9a-4a26-8baf-13975c64e4a7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:38.926962 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b82a282b-ca9a-4a26-8baf-13975c64e4a7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:38.927396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b82a282b-ca9a-4a26-8baf-13975c64e4a7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:38.928106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b82a282b-ca9a-4a26-8baf-13975c64e4a7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:38.928551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b82a282b-ca9a-4a26-8baf-13975c64e4a7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:38.929005 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b82a282b-ca9a-4a26-8baf-13975c64e4a7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:39.055953 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b82a282b-ca9a-4a26-8baf-13975c64e4a7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:39.063993 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b82a282b-ca9a-4a26-8baf-13975c64e4a7 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.148816 Oct 20 13:44:39.064551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 663/1038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:38 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:40.087589 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f4d34d9f-6636-4e39-b3b1-d7a00274057d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:40.088250 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f4d34d9f-6636-4e39-b3b1-d7a00274057d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:40.096968 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4d34d9f-6636-4e39-b3b1-d7a00274057d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:40.097460 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4d34d9f-6636-4e39-b3b1-d7a00274057d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:40.097895 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4d34d9f-6636-4e39-b3b1-d7a00274057d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:40.098596 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4d34d9f-6636-4e39-b3b1-d7a00274057d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:40.099048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4d34d9f-6636-4e39-b3b1-d7a00274057d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:40.099469 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f4d34d9f-6636-4e39-b3b1-d7a00274057d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:40.225446 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f4d34d9f-6636-4e39-b3b1-d7a00274057d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:40.234212 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f4d34d9f-6636-4e39-b3b1-d7a00274057d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.149382 Oct 20 13:44:40.234792 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 664/1039] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:40 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:41.256052 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-5cd07fbb-4e5b-4aa9-aa3a-e3648a52a9db tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:41.256726 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-5cd07fbb-4e5b-4aa9-aa3a-e3648a52a9db tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:41.263060 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5cd07fbb-4e5b-4aa9-aa3a-e3648a52a9db tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:41.263537 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5cd07fbb-4e5b-4aa9-aa3a-e3648a52a9db tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:41.263966 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5cd07fbb-4e5b-4aa9-aa3a-e3648a52a9db tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:41.265377 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5cd07fbb-4e5b-4aa9-aa3a-e3648a52a9db tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:41.265804 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5cd07fbb-4e5b-4aa9-aa3a-e3648a52a9db tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:41.266222 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-5cd07fbb-4e5b-4aa9-aa3a-e3648a52a9db tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:41.395736 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-5cd07fbb-4e5b-4aa9-aa3a-e3648a52a9db tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:41.403331 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-5cd07fbb-4e5b-4aa9-aa3a-e3648a52a9db tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.151125 Oct 20 13:44:41.403894 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 665/1040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:41 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:42.426392 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8e3d8039-dceb-488d-968c-e48c556abdbf tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:42.427026 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-8e3d8039-dceb-488d-968c-e48c556abdbf tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:42.433352 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e3d8039-dceb-488d-968c-e48c556abdbf tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:42.433836 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e3d8039-dceb-488d-968c-e48c556abdbf tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:42.434267 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e3d8039-dceb-488d-968c-e48c556abdbf tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:42.434946 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e3d8039-dceb-488d-968c-e48c556abdbf tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:42.435392 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e3d8039-dceb-488d-968c-e48c556abdbf tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:42.435816 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-8e3d8039-dceb-488d-968c-e48c556abdbf tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:42.563535 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-8e3d8039-dceb-488d-968c-e48c556abdbf tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:42.571145 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8e3d8039-dceb-488d-968c-e48c556abdbf tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.148669 Oct 20 13:44:42.571713 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 666/1041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:42 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:43.593671 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d1003364-744e-4ffe-9246-8361a0697882 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:43.594322 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d1003364-744e-4ffe-9246-8361a0697882 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:43.596213 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=2 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:43.596923 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell0:SELECT=8 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:43.603592 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1003364-744e-4ffe-9246-8361a0697882 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:43.604072 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1003364-744e-4ffe-9246-8361a0697882 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:43.604506 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1003364-744e-4ffe-9246-8361a0697882 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:43.605225 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1003364-744e-4ffe-9246-8361a0697882 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:43.605676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1003364-744e-4ffe-9246-8361a0697882 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:43.606101 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1003364-744e-4ffe-9246-8361a0697882 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:43.740080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d1003364-744e-4ffe-9246-8361a0697882 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:43.747963 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d1003364-744e-4ffe-9246-8361a0697882 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.158326 Oct 20 13:44:43.748530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 667/1042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:43 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:44.771889 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-00522995-444f-4076-958c-d8ae2789795c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:44.772508 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-00522995-444f-4076-958c-d8ae2789795c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:44.778951 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00522995-444f-4076-958c-d8ae2789795c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:44.779452 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00522995-444f-4076-958c-d8ae2789795c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:44.779870 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00522995-444f-4076-958c-d8ae2789795c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:44.781252 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00522995-444f-4076-958c-d8ae2789795c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:44.781713 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00522995-444f-4076-958c-d8ae2789795c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:44.782141 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-00522995-444f-4076-958c-d8ae2789795c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:44.911495 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-00522995-444f-4076-958c-d8ae2789795c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:44.919088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-00522995-444f-4076-958c-d8ae2789795c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.151176 Oct 20 13:44:44.919664 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 668/1043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:44 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:45.942745 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-47dd8907-f647-4987-8a70-61bd3045796a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:45.943443 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-47dd8907-f647-4987-8a70-61bd3045796a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:45.949482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-47dd8907-f647-4987-8a70-61bd3045796a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:45.949989 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-47dd8907-f647-4987-8a70-61bd3045796a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:45.950628 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-47dd8907-f647-4987-8a70-61bd3045796a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:45.951350 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-47dd8907-f647-4987-8a70-61bd3045796a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:45.951801 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-47dd8907-f647-4987-8a70-61bd3045796a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:45.952313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-47dd8907-f647-4987-8a70-61bd3045796a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:46.089793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-47dd8907-f647-4987-8a70-61bd3045796a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:46.098047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-47dd8907-f647-4987-8a70-61bd3045796a tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.159105 Oct 20 13:44:46.098618 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 669/1044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:45 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:46.103059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-7a2ab617-c44b-4386-8eef-366bff3ec379 req-d1df84a4-f5a8-4047-bd33-a02124e26b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c93d82ad-cde4-4b8f-84c3-2a3891ebd707", "name": "network-vif-plugged", "status": "completed", "tag": "c60610d5-8cbd-4e4d-91b4-6eab27fabd56"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:44:46.111796 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7a2ab617-c44b-4386-8eef-366bff3ec379 req-d1df84a4-f5a8-4047-bd33-a02124e26b45 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:46.112265 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7a2ab617-c44b-4386-8eef-366bff3ec379 req-d1df84a4-f5a8-4047-bd33-a02124e26b45 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:46.112688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7a2ab617-c44b-4386-8eef-366bff3ec379 req-d1df84a4-f5a8-4047-bd33-a02124e26b45 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:46.123651 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-7a2ab617-c44b-4386-8eef-366bff3ec379 req-d1df84a4-f5a8-4047-bd33-a02124e26b45 service nova] Creating event network-vif-plugged:c60610d5-8cbd-4e4d-91b4-6eab27fabd56 for instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 on hv-cinder-86213 Oct 20 13:44:46.128746 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-7a2ab617-c44b-4386-8eef-366bff3ec379 req-d1df84a4-f5a8-4047-bd33-a02124e26b45 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029053 Oct 20 13:44:46.129361 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 670/1045] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:44:47.121769 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d1ed0817-11f4-49b6-bb60-cce0aa62ca76 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:47.122455 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d1ed0817-11f4-49b6-bb60-cce0aa62ca76 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:47.129235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1ed0817-11f4-49b6-bb60-cce0aa62ca76 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:47.129706 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1ed0817-11f4-49b6-bb60-cce0aa62ca76 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:47.130135 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1ed0817-11f4-49b6-bb60-cce0aa62ca76 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:47.130816 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1ed0817-11f4-49b6-bb60-cce0aa62ca76 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:47.131258 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1ed0817-11f4-49b6-bb60-cce0aa62ca76 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:47.131672 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d1ed0817-11f4-49b6-bb60-cce0aa62ca76 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:47.261408 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d1ed0817-11f4-49b6-bb60-cce0aa62ca76 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:47.268924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d1ed0817-11f4-49b6-bb60-cce0aa62ca76 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1259 microversion: 2.1 time: 0.151929 Oct 20 13:44:47.269488 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 671/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:47 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:48.292071 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3f149f09-d43b-4a23-bc75-c65bf2a98f93 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:48.292719 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3f149f09-d43b-4a23-bc75-c65bf2a98f93 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:48.299418 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3f149f09-d43b-4a23-bc75-c65bf2a98f93 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:48.299892 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3f149f09-d43b-4a23-bc75-c65bf2a98f93 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:48.300316 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3f149f09-d43b-4a23-bc75-c65bf2a98f93 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:48.301017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3f149f09-d43b-4a23-bc75-c65bf2a98f93 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:48.301465 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3f149f09-d43b-4a23-bc75-c65bf2a98f93 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:48.301880 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3f149f09-d43b-4a23-bc75-c65bf2a98f93 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:48.430914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3f149f09-d43b-4a23-bc75-c65bf2a98f93 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:48.438634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3f149f09-d43b-4a23-bc75-c65bf2a98f93 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1443 microversion: 2.1 time: 0.150589 Oct 20 13:44:48.439196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 672/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:48 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:48.460476 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1e48efe8-4e09-4127-a4d9-e7c50c936f16 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:44:48.461175 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1e48efe8-4e09-4127-a4d9-e7c50c936f16 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:44:48.466740 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e48efe8-4e09-4127-a4d9-e7c50c936f16 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:48.467218 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e48efe8-4e09-4127-a4d9-e7c50c936f16 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:48.467650 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e48efe8-4e09-4127-a4d9-e7c50c936f16 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:48.468329 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e48efe8-4e09-4127-a4d9-e7c50c936f16 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:48.468778 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e48efe8-4e09-4127-a4d9-e7c50c936f16 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:48.469226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1e48efe8-4e09-4127-a4d9-e7c50c936f16 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:48.597919 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1e48efe8-4e09-4127-a4d9-e7c50c936f16 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:44:48.605526 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1e48efe8-4e09-4127-a4d9-e7c50c936f16 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1443 microversion: 2.1 time: 0.148542 Oct 20 13:44:48.606095 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 673/1048] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:44:48 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:44:50.284265 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-7ca34934-6947-417f-b1dd-1e5ef8d056e9 req-a4fe255c-5dee-4d96-9991-05bf0c9c1a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c93d82ad-cde4-4b8f-84c3-2a3891ebd707", "tag": "c60610d5-8cbd-4e4d-91b4-6eab27fabd56"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:44:50.294313 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7ca34934-6947-417f-b1dd-1e5ef8d056e9 req-a4fe255c-5dee-4d96-9991-05bf0c9c1a4f service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:44:50.294852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7ca34934-6947-417f-b1dd-1e5ef8d056e9 req-a4fe255c-5dee-4d96-9991-05bf0c9c1a4f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:44:50.295368 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-7ca34934-6947-417f-b1dd-1e5ef8d056e9 req-a4fe255c-5dee-4d96-9991-05bf0c9c1a4f service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:44:50.306790 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-7ca34934-6947-417f-b1dd-1e5ef8d056e9 req-a4fe255c-5dee-4d96-9991-05bf0c9c1a4f service nova] Creating event network-changed:c60610d5-8cbd-4e4d-91b4-6eab27fabd56 for instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 on hv-cinder-86213 Oct 20 13:44:50.311747 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-7ca34934-6947-417f-b1dd-1e5ef8d056e9 req-a4fe255c-5dee-4d96-9991-05bf0c9c1a4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031352 Oct 20 13:44:50.312348 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 674/1049] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:45:43.161591 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 13:45:43.162218 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Thu Oct 20 13:45:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 20 13:45:52.799154 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 13:45:52.799713 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Thu Oct 20 13:45:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 20 13:46:09.112022 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 13:46:09.112588 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Thu Oct 20 13:46:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 20 13:46:47.921936 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fbc6b0d1-e29d-405e-b08a-a299ead2c4a6] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 20 13:46:47.922606 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:46:47.923337 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=92 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:46:47.929305 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d0e3755d-d952-4225-9956-7ac6a0f1f89d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:46:47.929917 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d0e3755d-d952-4225-9956-7ac6a0f1f89d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:47.937603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0e3755d-d952-4225-9956-7ac6a0f1f89d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:47.938074 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0e3755d-d952-4225-9956-7ac6a0f1f89d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:47.938499 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0e3755d-d952-4225-9956-7ac6a0f1f89d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:47.939173 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0e3755d-d952-4225-9956-7ac6a0f1f89d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:47.939755 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0e3755d-d952-4225-9956-7ac6a0f1f89d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:47.940253 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d0e3755d-d952-4225-9956-7ac6a0f1f89d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:47.962976 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.objects.instance [None req-d0e3755d-d952-4225-9956-7ac6a0f1f89d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lazy-loading 'flavor' on Instance uuid c93d82ad-cde4-4b8f-84c3-2a3891ebd707 {{(pid=125448) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 13:46:48.033940 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d0e3755d-d952-4225-9956-7ac6a0f1f89d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "POST /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707/action" status: 202 len: 0 microversion: 2.1 time: 0.112844 Oct 20 13:46:48.034499 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 675/1050] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:46:47 2022] POST /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 13:46:48.042924 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-57cc8e4c-b6f4-48d9-907b-7fc27d292f8f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:48.043615 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-57cc8e4c-b6f4-48d9-907b-7fc27d292f8f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:48.049820 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57cc8e4c-b6f4-48d9-907b-7fc27d292f8f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:48.050291 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57cc8e4c-b6f4-48d9-907b-7fc27d292f8f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:48.050741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57cc8e4c-b6f4-48d9-907b-7fc27d292f8f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:48.051423 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57cc8e4c-b6f4-48d9-907b-7fc27d292f8f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:48.051866 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57cc8e4c-b6f4-48d9-907b-7fc27d292f8f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:48.052276 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-57cc8e4c-b6f4-48d9-907b-7fc27d292f8f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:48.292005 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-57cc8e4c-b6f4-48d9-907b-7fc27d292f8f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:46:48.300206 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-57cc8e4c-b6f4-48d9-907b-7fc27d292f8f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.261339 Oct 20 13:46:48.300764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 676/1051] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:48 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:46:49.323551 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-9079f8db-cd57-48fd-a45d-1cf97d5e9628 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:49.324214 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-9079f8db-cd57-48fd-a45d-1cf97d5e9628 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:49.331823 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9079f8db-cd57-48fd-a45d-1cf97d5e9628 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:49.332333 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9079f8db-cd57-48fd-a45d-1cf97d5e9628 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:49.332764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9079f8db-cd57-48fd-a45d-1cf97d5e9628 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:49.333472 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9079f8db-cd57-48fd-a45d-1cf97d5e9628 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:49.333923 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9079f8db-cd57-48fd-a45d-1cf97d5e9628 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:49.334345 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-9079f8db-cd57-48fd-a45d-1cf97d5e9628 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:49.350852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO oslo.messaging._drivers.impl_rabbit [-] [fbc6b0d1-e29d-405e-b08a-a299ead2c4a6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43320. Oct 20 13:46:49.462420 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-9079f8db-cd57-48fd-a45d-1cf97d5e9628 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:46:49.470040 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-9079f8db-cd57-48fd-a45d-1cf97d5e9628 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.150420 Oct 20 13:46:49.470602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 677/1052] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:49 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:46:50.494492 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e144d016-5001-40f9-81f8-9cb8f7d0308b tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:50.495131 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e144d016-5001-40f9-81f8-9cb8f7d0308b tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:50.501580 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e144d016-5001-40f9-81f8-9cb8f7d0308b tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:50.502070 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e144d016-5001-40f9-81f8-9cb8f7d0308b tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:50.502512 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e144d016-5001-40f9-81f8-9cb8f7d0308b tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:50.503205 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e144d016-5001-40f9-81f8-9cb8f7d0308b tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:50.503805 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e144d016-5001-40f9-81f8-9cb8f7d0308b tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:50.504230 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e144d016-5001-40f9-81f8-9cb8f7d0308b tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:50.636389 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e144d016-5001-40f9-81f8-9cb8f7d0308b tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:46:50.644819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e144d016-5001-40f9-81f8-9cb8f7d0308b tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.153757 Oct 20 13:46:50.645428 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 678/1053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:50 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:46:51.669057 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-1aa70d87-b06f-46fe-b567-75699ad63eb1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:51.669693 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-1aa70d87-b06f-46fe-b567-75699ad63eb1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:51.676659 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1aa70d87-b06f-46fe-b567-75699ad63eb1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:51.677155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1aa70d87-b06f-46fe-b567-75699ad63eb1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:51.677585 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1aa70d87-b06f-46fe-b567-75699ad63eb1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:51.678255 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1aa70d87-b06f-46fe-b567-75699ad63eb1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:51.678700 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1aa70d87-b06f-46fe-b567-75699ad63eb1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:51.679114 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-1aa70d87-b06f-46fe-b567-75699ad63eb1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:51.809970 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-1aa70d87-b06f-46fe-b567-75699ad63eb1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:46:51.818099 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-1aa70d87-b06f-46fe-b567-75699ad63eb1 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.152996 Oct 20 13:46:51.818659 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 679/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:51 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:46:52.841128 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-42ee407b-c76a-4fd7-8cd4-f93265784e38 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:52.841775 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-42ee407b-c76a-4fd7-8cd4-f93265784e38 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:52.848659 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42ee407b-c76a-4fd7-8cd4-f93265784e38 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:52.849171 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42ee407b-c76a-4fd7-8cd4-f93265784e38 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:52.849598 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42ee407b-c76a-4fd7-8cd4-f93265784e38 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:52.850270 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42ee407b-c76a-4fd7-8cd4-f93265784e38 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:52.850712 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42ee407b-c76a-4fd7-8cd4-f93265784e38 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:52.851124 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-42ee407b-c76a-4fd7-8cd4-f93265784e38 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:52.983168 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-42ee407b-c76a-4fd7-8cd4-f93265784e38 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:46:52.991395 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-42ee407b-c76a-4fd7-8cd4-f93265784e38 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.154111 Oct 20 13:46:52.991902 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 680/1055] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:52 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:46:54.014602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-c2cd06f1-08d9-4b39-a6cf-bbb1a29dd9ce tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:54.015229 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-c2cd06f1-08d9-4b39-a6cf-bbb1a29dd9ce tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:54.022172 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c2cd06f1-08d9-4b39-a6cf-bbb1a29dd9ce tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:54.022653 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c2cd06f1-08d9-4b39-a6cf-bbb1a29dd9ce tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:54.023077 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c2cd06f1-08d9-4b39-a6cf-bbb1a29dd9ce tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:54.023764 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c2cd06f1-08d9-4b39-a6cf-bbb1a29dd9ce tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:54.024210 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c2cd06f1-08d9-4b39-a6cf-bbb1a29dd9ce tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:54.024627 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-c2cd06f1-08d9-4b39-a6cf-bbb1a29dd9ce tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:54.151106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-c2cd06f1-08d9-4b39-a6cf-bbb1a29dd9ce tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:46:54.158844 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-c2cd06f1-08d9-4b39-a6cf-bbb1a29dd9ce tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.148084 Oct 20 13:46:54.159346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 681/1056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:54 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:46:55.181902 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-e014a55b-3c55-4c43-b787-75f7d9742bfe tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:55.182581 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-e014a55b-3c55-4c43-b787-75f7d9742bfe tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:55.188906 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e014a55b-3c55-4c43-b787-75f7d9742bfe tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:55.189393 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e014a55b-3c55-4c43-b787-75f7d9742bfe tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:55.189826 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e014a55b-3c55-4c43-b787-75f7d9742bfe tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:55.190509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e014a55b-3c55-4c43-b787-75f7d9742bfe tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:55.190959 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e014a55b-3c55-4c43-b787-75f7d9742bfe tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:55.191425 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-e014a55b-3c55-4c43-b787-75f7d9742bfe tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:55.322702 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-e014a55b-3c55-4c43-b787-75f7d9742bfe tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:46:55.330383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-e014a55b-3c55-4c43-b787-75f7d9742bfe tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.152355 Oct 20 13:46:55.330955 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 682/1057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:55 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:46:56.354402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-d178a663-fcdf-49dc-bf52-5748bfcbc9d3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:56.355025 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-d178a663-fcdf-49dc-bf52-5748bfcbc9d3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:56.361490 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d178a663-fcdf-49dc-bf52-5748bfcbc9d3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:56.361962 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d178a663-fcdf-49dc-bf52-5748bfcbc9d3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:56.362386 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d178a663-fcdf-49dc-bf52-5748bfcbc9d3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:56.363809 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d178a663-fcdf-49dc-bf52-5748bfcbc9d3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:56.364263 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d178a663-fcdf-49dc-bf52-5748bfcbc9d3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:56.364682 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-d178a663-fcdf-49dc-bf52-5748bfcbc9d3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:56.494783 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-d178a663-fcdf-49dc-bf52-5748bfcbc9d3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:46:56.502509 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-d178a663-fcdf-49dc-bf52-5748bfcbc9d3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.152025 Oct 20 13:46:56.503093 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 683/1058] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:56 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:46:57.525631 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-4d330cec-0f3b-4626-8862-ef1a77ff0f8c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:57.526241 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-4d330cec-0f3b-4626-8862-ef1a77ff0f8c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:57.532573 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d330cec-0f3b-4626-8862-ef1a77ff0f8c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:57.533116 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d330cec-0f3b-4626-8862-ef1a77ff0f8c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:57.533552 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d330cec-0f3b-4626-8862-ef1a77ff0f8c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:57.534230 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d330cec-0f3b-4626-8862-ef1a77ff0f8c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:57.534680 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d330cec-0f3b-4626-8862-ef1a77ff0f8c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:57.535162 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-4d330cec-0f3b-4626-8862-ef1a77ff0f8c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:57.663608 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-4d330cec-0f3b-4626-8862-ef1a77ff0f8c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:46:57.671239 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-4d330cec-0f3b-4626-8862-ef1a77ff0f8c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.149486 Oct 20 13:46:57.671816 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 684/1059] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:57 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:46:58.695438 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-0fd14806-25d3-4efd-8fa0-dd3a030cbbfc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:58.696088 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-0fd14806-25d3-4efd-8fa0-dd3a030cbbfc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:58.702691 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0fd14806-25d3-4efd-8fa0-dd3a030cbbfc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:58.703170 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0fd14806-25d3-4efd-8fa0-dd3a030cbbfc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:58.703604 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0fd14806-25d3-4efd-8fa0-dd3a030cbbfc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:58.704294 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0fd14806-25d3-4efd-8fa0-dd3a030cbbfc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:58.704749 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0fd14806-25d3-4efd-8fa0-dd3a030cbbfc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:58.705203 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-0fd14806-25d3-4efd-8fa0-dd3a030cbbfc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:58.862652 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-0fd14806-25d3-4efd-8fa0-dd3a030cbbfc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:46:58.870518 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-0fd14806-25d3-4efd-8fa0-dd3a030cbbfc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.179525 Oct 20 13:46:58.871089 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 685/1060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:58 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:46:59.895196 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-3d8d2fe0-a92d-4a69-9d7e-b48c31a0bd1f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:46:59.895848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-3d8d2fe0-a92d-4a69-9d7e-b48c31a0bd1f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:46:59.902112 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d8d2fe0-a92d-4a69-9d7e-b48c31a0bd1f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:59.902582 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d8d2fe0-a92d-4a69-9d7e-b48c31a0bd1f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:59.903010 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d8d2fe0-a92d-4a69-9d7e-b48c31a0bd1f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:46:59.903711 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d8d2fe0-a92d-4a69-9d7e-b48c31a0bd1f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:46:59.904155 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d8d2fe0-a92d-4a69-9d7e-b48c31a0bd1f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:46:59.904569 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-3d8d2fe0-a92d-4a69-9d7e-b48c31a0bd1f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:00.030965 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-3d8d2fe0-a92d-4a69-9d7e-b48c31a0bd1f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:00.039124 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-3d8d2fe0-a92d-4a69-9d7e-b48c31a0bd1f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.148612 Oct 20 13:47:00.039708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 686/1061] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:46:59 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:01.062400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-672e6675-4734-45f4-a0c2-e91e658d68e0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:01.063782 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-672e6675-4734-45f4-a0c2-e91e658d68e0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:01.071020 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-672e6675-4734-45f4-a0c2-e91e658d68e0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:01.071494 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-672e6675-4734-45f4-a0c2-e91e658d68e0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:01.071920 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-672e6675-4734-45f4-a0c2-e91e658d68e0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:01.072602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-672e6675-4734-45f4-a0c2-e91e658d68e0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:01.073080 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-672e6675-4734-45f4-a0c2-e91e658d68e0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:01.073497 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-672e6675-4734-45f4-a0c2-e91e658d68e0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:01.214202 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-672e6675-4734-45f4-a0c2-e91e658d68e0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:01.221974 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-672e6675-4734-45f4-a0c2-e91e658d68e0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1568 microversion: 2.1 time: 0.163542 Oct 20 13:47:01.222669 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 687/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:01 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:01.244722 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:47:01.245351 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:01.251047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:01.251522 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:01.251950 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:01.252624 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:01.253104 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:01.254102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:01.281400 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125448) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 20 13:47:01.323249 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:47:01.345047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [098b30ce-35e5-438c-905a-3669d14991d3] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 20 13:47:02.353852 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO oslo.messaging._drivers.impl_rabbit [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [098b30ce-35e5-438c-905a-3669d14991d3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43348. Oct 20 13:47:02.357003 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-aa911e2b-ca3f-4334-b90a-c067f3caa7b2 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "POST /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707/action" status: 202 len: 0 microversion: 2.1 time: 1.115949 Oct 20 13:47:02.357787 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 688/1063] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 20 13:47:01 2022] POST /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707/action => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 13:47:02.367346 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-6da27782-226c-4339-91e8-edba6072d696 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:02.367948 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-6da27782-226c-4339-91e8-edba6072d696 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:02.374094 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6da27782-226c-4339-91e8-edba6072d696 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:02.374571 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6da27782-226c-4339-91e8-edba6072d696 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:02.375019 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6da27782-226c-4339-91e8-edba6072d696 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:02.375707 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6da27782-226c-4339-91e8-edba6072d696 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:02.376148 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6da27782-226c-4339-91e8-edba6072d696 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:02.376564 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-6da27782-226c-4339-91e8-edba6072d696 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:02.540229 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-6da27782-226c-4339-91e8-edba6072d696 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:02.548059 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-6da27782-226c-4339-91e8-edba6072d696 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1516 microversion: 2.1 time: 0.185551 Oct 20 13:47:02.548708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 689/1064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:02 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:03.571530 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b3da9d23-5f41-444c-83e7-557f8e3172f9 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:03.572187 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b3da9d23-5f41-444c-83e7-557f8e3172f9 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:03.578520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b3da9d23-5f41-444c-83e7-557f8e3172f9 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:03.579002 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b3da9d23-5f41-444c-83e7-557f8e3172f9 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:03.579493 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b3da9d23-5f41-444c-83e7-557f8e3172f9 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:03.580187 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b3da9d23-5f41-444c-83e7-557f8e3172f9 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:03.580642 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b3da9d23-5f41-444c-83e7-557f8e3172f9 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:03.581159 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b3da9d23-5f41-444c-83e7-557f8e3172f9 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:03.715730 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b3da9d23-5f41-444c-83e7-557f8e3172f9 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:03.724214 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b3da9d23-5f41-444c-83e7-557f8e3172f9 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1518 microversion: 2.1 time: 0.156511 Oct 20 13:47:03.724789 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 690/1065] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:03 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:04.643943 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-a45f9114-9e47-467c-ae9b-0d671978b428 req-55452f58-ffb0-4c0d-9b50-a7f1c64d6b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c93d82ad-cde4-4b8f-84c3-2a3891ebd707", "name": "network-vif-unplugged", "status": "completed", "tag": "c60610d5-8cbd-4e4d-91b4-6eab27fabd56"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:47:04.654024 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-a45f9114-9e47-467c-ae9b-0d671978b428 req-55452f58-ffb0-4c0d-9b50-a7f1c64d6b32 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:04.654496 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-a45f9114-9e47-467c-ae9b-0d671978b428 req-55452f58-ffb0-4c0d-9b50-a7f1c64d6b32 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:04.655110 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-a45f9114-9e47-467c-ae9b-0d671978b428 req-55452f58-ffb0-4c0d-9b50-a7f1c64d6b32 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:04.672733 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-a45f9114-9e47-467c-ae9b-0d671978b428 req-55452f58-ffb0-4c0d-9b50-a7f1c64d6b32 service nova] Creating event network-vif-unplugged:c60610d5-8cbd-4e4d-91b4-6eab27fabd56 for instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 on hv-cinder-86213 Oct 20 13:47:04.677861 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-a45f9114-9e47-467c-ae9b-0d671978b428 req-55452f58-ffb0-4c0d-9b50-a7f1c64d6b32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105103 Oct 20 13:47:04.678456 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 691/1066] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:47:04.748213 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-190b0b3c-15ee-4f34-be46-cad4e7bf216c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:04.748931 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-190b0b3c-15ee-4f34-be46-cad4e7bf216c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:04.755606 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-190b0b3c-15ee-4f34-be46-cad4e7bf216c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:04.756083 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-190b0b3c-15ee-4f34-be46-cad4e7bf216c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:04.756513 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-190b0b3c-15ee-4f34-be46-cad4e7bf216c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:04.757230 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-190b0b3c-15ee-4f34-be46-cad4e7bf216c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:04.757681 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-190b0b3c-15ee-4f34-be46-cad4e7bf216c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:04.758103 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-190b0b3c-15ee-4f34-be46-cad4e7bf216c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:04.952814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-190b0b3c-15ee-4f34-be46-cad4e7bf216c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:04.961439 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-190b0b3c-15ee-4f34-be46-cad4e7bf216c tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1574 microversion: 2.1 time: 0.217485 Oct 20 13:47:04.962007 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 692/1067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:04 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1574 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:05.984428 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-993d1602-e7f0-4370-ae8b-dbefef25e969 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:05.985106 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-993d1602-e7f0-4370-ae8b-dbefef25e969 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:05.991784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-993d1602-e7f0-4370-ae8b-dbefef25e969 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:05.992261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-993d1602-e7f0-4370-ae8b-dbefef25e969 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:05.992688 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-993d1602-e7f0-4370-ae8b-dbefef25e969 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:05.993397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-993d1602-e7f0-4370-ae8b-dbefef25e969 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:05.993842 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-993d1602-e7f0-4370-ae8b-dbefef25e969 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:05.994268 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-993d1602-e7f0-4370-ae8b-dbefef25e969 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:06.122541 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-993d1602-e7f0-4370-ae8b-dbefef25e969 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:06.130805 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-993d1602-e7f0-4370-ae8b-dbefef25e969 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1574 microversion: 2.1 time: 0.150265 Oct 20 13:47:06.131364 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 693/1068] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:05 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:07.153872 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b133831e-b8a4-4295-9357-0e117903dfc5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:07.154529 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b133831e-b8a4-4295-9357-0e117903dfc5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:07.160887 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b133831e-b8a4-4295-9357-0e117903dfc5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:07.161371 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b133831e-b8a4-4295-9357-0e117903dfc5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:07.161810 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b133831e-b8a4-4295-9357-0e117903dfc5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:07.162498 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b133831e-b8a4-4295-9357-0e117903dfc5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:07.162956 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b133831e-b8a4-4295-9357-0e117903dfc5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:07.163384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b133831e-b8a4-4295-9357-0e117903dfc5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:07.294311 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b133831e-b8a4-4295-9357-0e117903dfc5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:07.302796 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b133831e-b8a4-4295-9357-0e117903dfc5 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1574 microversion: 2.1 time: 0.152770 Oct 20 13:47:07.304411 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 694/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:07 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:08.327236 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-034b1140-a088-4f37-95e3-17a71727e289 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:08.327979 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-034b1140-a088-4f37-95e3-17a71727e289 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:08.334305 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-034b1140-a088-4f37-95e3-17a71727e289 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:08.334791 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-034b1140-a088-4f37-95e3-17a71727e289 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:08.335227 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-034b1140-a088-4f37-95e3-17a71727e289 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:08.335914 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-034b1140-a088-4f37-95e3-17a71727e289 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:08.336396 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-034b1140-a088-4f37-95e3-17a71727e289 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:08.336819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-034b1140-a088-4f37-95e3-17a71727e289 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:08.465397 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-034b1140-a088-4f37-95e3-17a71727e289 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:08.474047 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-034b1140-a088-4f37-95e3-17a71727e289 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1574 microversion: 2.1 time: 0.150682 Oct 20 13:47:08.474617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 695/1070] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:08 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:09.498633 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-496da0c7-cd9a-49ee-9761-4075dca302cc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:09.499306 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-496da0c7-cd9a-49ee-9761-4075dca302cc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:09.506477 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-496da0c7-cd9a-49ee-9761-4075dca302cc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:09.506952 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-496da0c7-cd9a-49ee-9761-4075dca302cc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:09.507374 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-496da0c7-cd9a-49ee-9761-4075dca302cc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:09.508050 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-496da0c7-cd9a-49ee-9761-4075dca302cc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:09.508516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-496da0c7-cd9a-49ee-9761-4075dca302cc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:09.508964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-496da0c7-cd9a-49ee-9761-4075dca302cc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:09.638068 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-496da0c7-cd9a-49ee-9761-4075dca302cc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:09.645625 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-496da0c7-cd9a-49ee-9761-4075dca302cc tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1574 microversion: 2.1 time: 0.150856 Oct 20 13:47:09.646190 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 696/1071] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:09 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:10.668525 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2d950c94-9cfa-4d1d-adff-7491cb1be2ac tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:10.669194 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2d950c94-9cfa-4d1d-adff-7491cb1be2ac tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:10.676137 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d950c94-9cfa-4d1d-adff-7491cb1be2ac tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:10.676691 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d950c94-9cfa-4d1d-adff-7491cb1be2ac tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:10.677143 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d950c94-9cfa-4d1d-adff-7491cb1be2ac tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:10.677848 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d950c94-9cfa-4d1d-adff-7491cb1be2ac tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:10.678292 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d950c94-9cfa-4d1d-adff-7491cb1be2ac tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:10.678708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2d950c94-9cfa-4d1d-adff-7491cb1be2ac tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:10.808669 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-2d950c94-9cfa-4d1d-adff-7491cb1be2ac tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:10.817021 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2d950c94-9cfa-4d1d-adff-7491cb1be2ac tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1574 microversion: 2.1 time: 0.152232 Oct 20 13:47:10.817581 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 697/1072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:10 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:11.840734 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-b1bc2ffe-1ca7-4c1d-a72a-7a62aaa08cf0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:11.841411 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-b1bc2ffe-1ca7-4c1d-a72a-7a62aaa08cf0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:11.848892 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1bc2ffe-1ca7-4c1d-a72a-7a62aaa08cf0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:11.849384 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1bc2ffe-1ca7-4c1d-a72a-7a62aaa08cf0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:11.849814 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1bc2ffe-1ca7-4c1d-a72a-7a62aaa08cf0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:11.850516 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1bc2ffe-1ca7-4c1d-a72a-7a62aaa08cf0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:11.850964 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1bc2ffe-1ca7-4c1d-a72a-7a62aaa08cf0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:11.851383 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-b1bc2ffe-1ca7-4c1d-a72a-7a62aaa08cf0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:11.980592 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-b1bc2ffe-1ca7-4c1d-a72a-7a62aaa08cf0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:11.988687 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-b1bc2ffe-1ca7-4c1d-a72a-7a62aaa08cf0 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1574 microversion: 2.1 time: 0.151687 Oct 20 13:47:11.989290 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 698/1073] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:11 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:13.012385 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-f386c30c-a9c0-4fe6-b9b5-92624521407d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:47:13.013051 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-f386c30c-a9c0-4fe6-b9b5-92624521407d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:47:13.020118 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f386c30c-a9c0-4fe6-b9b5-92624521407d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:13.020593 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f386c30c-a9c0-4fe6-b9b5-92624521407d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:13.021056 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f386c30c-a9c0-4fe6-b9b5-92624521407d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:13.021833 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f386c30c-a9c0-4fe6-b9b5-92624521407d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:13.022335 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f386c30c-a9c0-4fe6-b9b5-92624521407d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:13.022772 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-f386c30c-a9c0-4fe6-b9b5-92624521407d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:13.152102 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-f386c30c-a9c0-4fe6-b9b5-92624521407d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:47:13.159879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-f386c30c-a9c0-4fe6-b9b5-92624521407d tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1561 microversion: 2.1 time: 0.151335 Oct 20 13:47:13.160474 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 699/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:47:13 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:47:16.672891 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-6acaa16a-53e6-418e-9441-184e74803b9a req-66f8e633-d6db-4916-b390-8d41a39161d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c93d82ad-cde4-4b8f-84c3-2a3891ebd707", "name": "network-vif-plugged", "status": "completed", "tag": "c60610d5-8cbd-4e4d-91b4-6eab27fabd56"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:47:16.683402 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6acaa16a-53e6-418e-9441-184e74803b9a req-66f8e633-d6db-4916-b390-8d41a39161d2 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:47:16.683874 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6acaa16a-53e6-418e-9441-184e74803b9a req-66f8e633-d6db-4916-b390-8d41a39161d2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:47:16.684295 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-6acaa16a-53e6-418e-9441-184e74803b9a req-66f8e633-d6db-4916-b390-8d41a39161d2 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:47:16.696751 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-6acaa16a-53e6-418e-9441-184e74803b9a req-66f8e633-d6db-4916-b390-8d41a39161d2 service nova] Creating event network-vif-plugged:c60610d5-8cbd-4e4d-91b4-6eab27fabd56 for instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 on hv-cinder-86213 Oct 20 13:47:16.701785 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-6acaa16a-53e6-418e-9441-184e74803b9a req-66f8e633-d6db-4916-b390-8d41a39161d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032519 Oct 20 13:47:16.702885 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 700/1075] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:48:26.637793 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:48:26.639465 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG dbcounter [-] [125448] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=125448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:48:26.644893 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2ecfb212-0a26-4c68-ba8d-9270d8d08e45 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:48:26.645482 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2ecfb212-0a26-4c68-ba8d-9270d8d08e45 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:48:26.654206 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ecfb212-0a26-4c68-ba8d-9270d8d08e45 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:26.654678 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ecfb212-0a26-4c68-ba8d-9270d8d08e45 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:26.655099 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ecfb212-0a26-4c68-ba8d-9270d8d08e45 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:26.655780 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ecfb212-0a26-4c68-ba8d-9270d8d08e45 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:26.656226 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ecfb212-0a26-4c68-ba8d-9270d8d08e45 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:26.656640 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2ecfb212-0a26-4c68-ba8d-9270d8d08e45 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:26.683262 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2ecfb212-0a26-4c68-ba8d-9270d8d08e45 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Going to try to terminate instance {{(pid=125448) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 13:48:26.759921 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2ecfb212-0a26-4c68-ba8d-9270d8d08e45 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 204 len: 0 microversion: 2.1 time: 0.124176 Oct 20 13:48:26.763634 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 701/1076] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 20 13:48:26 2022] DELETE /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 20 13:48:26.823058 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-2611eea6-5b16-4556-b0b0-a47f84a5fa45 req-04eec6e6-1a79-455b-ba75-d3d8a26078bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c93d82ad-cde4-4b8f-84c3-2a3891ebd707", "tag": "c60610d5-8cbd-4e4d-91b4-6eab27fabd56"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:48:26.832316 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2611eea6-5b16-4556-b0b0-a47f84a5fa45 req-04eec6e6-1a79-455b-ba75-d3d8a26078bb service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:26.832784 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2611eea6-5b16-4556-b0b0-a47f84a5fa45 req-04eec6e6-1a79-455b-ba75-d3d8a26078bb service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:26.833233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-2611eea6-5b16-4556-b0b0-a47f84a5fa45 req-04eec6e6-1a79-455b-ba75-d3d8a26078bb service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:26.846851 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-2611eea6-5b16-4556-b0b0-a47f84a5fa45 req-04eec6e6-1a79-455b-ba75-d3d8a26078bb service nova] Creating event network-changed:c60610d5-8cbd-4e4d-91b4-6eab27fabd56 for instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 on hv-cinder-86213 Oct 20 13:48:26.852407 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-2611eea6-5b16-4556-b0b0-a47f84a5fa45 req-04eec6e6-1a79-455b-ba75-d3d8a26078bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090211 Oct 20 13:48:26.853031 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 702/1077] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 13:48:26.858168 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-082e0539-0cc8-4d5d-9003-4d1259792afb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:48:26.858640 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-082e0539-0cc8-4d5d-9003-4d1259792afb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:48:26.864879 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-082e0539-0cc8-4d5d-9003-4d1259792afb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:26.865545 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-082e0539-0cc8-4d5d-9003-4d1259792afb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:26.866066 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-082e0539-0cc8-4d5d-9003-4d1259792afb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:26.866763 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-082e0539-0cc8-4d5d-9003-4d1259792afb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:26.867214 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-082e0539-0cc8-4d5d-9003-4d1259792afb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:26.867637 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-082e0539-0cc8-4d5d-9003-4d1259792afb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:27.005239 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-082e0539-0cc8-4d5d-9003-4d1259792afb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:48:27.013790 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-082e0539-0cc8-4d5d-9003-4d1259792afb tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.159578 Oct 20 13:48:27.014286 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 703/1078] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:48:26 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 13:48:28.039048 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-fbf74fe2-45a6-4660-9fcb-d24819654e0f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:48:28.039708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-fbf74fe2-45a6-4660-9fcb-d24819654e0f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:48:28.043520 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 13:48:28.043666 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Thu Oct 20 13:48:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 (ip 10.222.0.23) !!! Oct 20 13:48:28.049124 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbf74fe2-45a6-4660-9fcb-d24819654e0f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:28.049605 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbf74fe2-45a6-4660-9fcb-d24819654e0f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:28.050037 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbf74fe2-45a6-4660-9fcb-d24819654e0f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:28.050734 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbf74fe2-45a6-4660-9fcb-d24819654e0f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:28.051182 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbf74fe2-45a6-4660-9fcb-d24819654e0f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:28.051603 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-fbf74fe2-45a6-4660-9fcb-d24819654e0f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:28.501982 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-fbf74fe2-45a6-4660-9fcb-d24819654e0f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:48:28.510704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-fbf74fe2-45a6-4660-9fcb-d24819654e0f tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1567 microversion: 2.1 time: 0.476307 Oct 20 13:48:28.511570 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 704/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:48:28 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1567 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:48:29.199017 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [req-1bdc7486-2295-4829-890f-67969d51e78c req-cb929e81-44b0-46d8-8517-7e8f756dec84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c93d82ad-cde4-4b8f-84c3-2a3891ebd707", "name": "network-vif-deleted", "tag": "c60610d5-8cbd-4e4d-91b4-6eab27fabd56"}]} {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 13:48:29.208941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-1bdc7486-2295-4829-890f-67969d51e78c req-cb929e81-44b0-46d8-8517-7e8f756dec84 service nova] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:29.209498 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-1bdc7486-2295-4829-890f-67969d51e78c req-cb929e81-44b0-46d8-8517-7e8f756dec84 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:29.209931 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [req-1bdc7486-2295-4829-890f-67969d51e78c req-cb929e81-44b0-46d8-8517-7e8f756dec84 service nova] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:29.221483 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.compute.server_external_events [req-1bdc7486-2295-4829-890f-67969d51e78c req-cb929e81-44b0-46d8-8517-7e8f756dec84 service nova] Creating event network-vif-deleted:c60610d5-8cbd-4e4d-91b4-6eab27fabd56 for instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 on hv-cinder-86213 Oct 20 13:48:29.227013 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [req-1bdc7486-2295-4829-890f-67969d51e78c req-cb929e81-44b0-46d8-8517-7e8f756dec84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087783 Oct 20 13:48:29.227704 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 705/1080] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 20 13:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 13:48:29.534305 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-425fc446-e074-4696-b703-9946822feba3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:48:29.535096 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-425fc446-e074-4696-b703-9946822feba3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:48:29.541819 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-425fc446-e074-4696-b703-9946822feba3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:29.542306 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-425fc446-e074-4696-b703-9946822feba3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:29.542741 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-425fc446-e074-4696-b703-9946822feba3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:29.543435 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-425fc446-e074-4696-b703-9946822feba3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:29.544070 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-425fc446-e074-4696-b703-9946822feba3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:29.544655 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-425fc446-e074-4696-b703-9946822feba3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:29.612025 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.policy [None req-425fc446-e074-4696-b703-9946822feba3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7a6b4a92ff4232843913a1dbd7f1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de4676254c14b55aa2b7765255c69c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125448) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 13:48:29.621317 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-425fc446-e074-4696-b703-9946822feba3 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 200 len: 1219 microversion: 2.1 time: 0.091456 Oct 20 13:48:29.621941 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 706/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:48:29 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 13:48:30.644929 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:48:30.645522 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.compute.api [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] [instance: c93d82ad-cde4-4b8f-84c3-2a3891ebd707] Fetching instance by UUID {{(pid=125448) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 13:48:30.652617 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:30.653132 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:30.653562 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:30.654235 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Acquiring lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 13:48:30.654676 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 13:48:30.655092 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG oslo_concurrency.lockutils [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Lock "f1966287-b3a3-4c20-97b3-61dda7e72f23" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 13:48:30.668602 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.wsgi [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] HTTP exception thrown: Instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 could not be found. Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Request method failure captured: Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: request: GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 HTTP/1.1 Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept: application/json Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Accept-Encoding: identity Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Connection: close Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Length: 0 Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Content-Type: application/json Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Host: 10.222.0.23 Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: Openstack-System-Scope: None Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: User-Agent: python-urllib3/1.26.12 Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Auth-Token: gAAAAABjUVCj0qZErp7HLsBdn5gzsh4WdcELFnKwOghMnCiIvwIquwpQC3LDrX6K3FzMS6_52vy-ZLEoxErjVux63xAFC8D4hE-qN9caJ6r-aHMUzNCaS0i_6pt9pfUv_aMr_9eM175qBOgy-KrApJ4z92ArVKBGAVNlRn4pkkeMj8FudCAHjGo Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Id: None Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Domain-Name: None Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Identity-Status: Confirmed Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Is-Admin-Project: True Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Id: default Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Domain-Name: Default Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Id: 2de4676254c14b55aa2b7765255c69c9 Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Project-Name: tempest-TestShelveInstance-762883540 Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Role: member,reader Oct 20 13:48:30.670215 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Roles: member,reader Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2de4676254c14b55aa2b7765255c69c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2de4676254c14b55aa2b7765255c69c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2de4676254c14b55aa2b7765255c69c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2de4676254c14b55aa2b7765255c69c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant: tempest-TestShelveInstance-762883540 Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Id: 2de4676254c14b55aa2b7765255c69c9 Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-Tenant-Name: tempest-TestShelveInstance-762883540 Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User: tempest-TestShelveInstance-762883540-project Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Id: default Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Domain-Name: Default Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Id: 7f7a6b4a92ff4232843913a1dbd7f1c4 Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: X-User-Name: tempest-TestShelveInstance-762883540-project Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: method: > Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: exception: Instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 could not be found. Oct 20 13:48:30.671997 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: action_args: {'id': 'c93d82ad-cde4-4b8f-84c3-2a3891ebd707'} Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 could not be found. Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 13:48:30.673090 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 could not be found. Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 could not be found. Oct 20 13:48:30.674708 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: ERROR nova.api.openstack.wsgi Oct 20 13:48:30.676242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Returning 404 to user: Instance c93d82ad-cde4-4b8f-84c3-2a3891ebd707 could not be found. {{(pid=125448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 13:48:30.676242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-2cf238ce-3f84-4eda-864f-c73ec873e519 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707" status: 404 len: 111 microversion: 2.1 time: 0.030483 Oct 20 13:48:30.676242 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 707/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 20 13:48:30 2022] GET /compute/v2.1/servers/c93d82ad-cde4-4b8f-84c3-2a3891ebd707 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 13:48:30.831006 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: DEBUG nova.api.openstack.wsgi [None req-8306be9e-af26-4b19-a20d-a256954ebd55 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] Calling method '.version_select at 0x7ffa166d4430>' {{(pid=125448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 13:48:30.854261 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: INFO nova.api.openstack.requestlog [None req-8306be9e-af26-4b19-a20d-a256954ebd55 tempest-TestShelveInstance-762883540 tempest-TestShelveInstance-762883540-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1174838333" status: 202 len: 0 microversion: 2.1 time: 0.027016 Oct 20 13:48:30.855233 dv-cinder-862136-1-iscsi devstack@n-api.service[125448]: [pid: 125448|app: 0|req: 708/1083] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Oct 20 13:48:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1174838333 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 13:49:03.171307 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 13:49:03.171898 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Thu Oct 20 13:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 20 13:49:12.810119 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 13:49:12.810732 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Thu Oct 20 13:49:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 20 13:49:29.122919 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 13:49:29.123511 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Thu Oct 20 13:49:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 20 13:52:23.180325 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 13:52:23.181046 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Thu Oct 20 13:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 20 13:52:32.818413 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 13:52:32.818979 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Thu Oct 20 13:52:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 20 13:52:49.134318 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 13:52:49.134947 dv-cinder-862136-1-iscsi devstack@n-api.service[125447]: Thu Oct 20 13:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!!